Empowering AI PC’s with Intel’s AI Software Stack | Tech Talk | Innovation Selects | Intel Software
17Intel's AI PC software stack simplifies AI development and deployment. It offers a comprehensive suite of tools and frameworks, including OpenVINO, ONNX Runtime, WebNN, and PyTorch, for seamless model integration. With the AI PC Development Kit and AI Playground, developers can easily experiment, prototype, and build AI applications, unlocking the potential of AI on PCs.
Discover how Intel's AI PC software stack is revolutionizing AI development and deployment, offering a suite of tools and frameworks that enable seamless model deployment and an out-of-the-box AI PC experience. Learn about the end-to-end model deployment flow, including runtimes and frameworks such as OpenVINO™ , ONNX Runtime, WebNN, and PyTorch. Leverage tools and solutions like the AI PC Development Kit and AI Playground for experimentation, rapid prototyping, and building AI applications. This session empowers you to harness the full potential of AI on PCs, driving innovation for developers and customers.
Intel Innovation:https://intel.ly/46ixwbAA
Intel Events:https://intel.ly/4dCbLWbb
Intel AI PChttps://www.intel.com/content/www/us/en/products/docs/processors/core-ultra/ai-pc.html.
How to get startedhttps://docs.openvino.ai/2024/get-started.htmlhttps://docs.openvino.ai/2024/_static/download/OpenVINO_Quick_Start_Guide.pdf.
OpenVINO Sampleshttps://github.com/openvinotoolkit/open_model_zoo/blob/master/demos/README.md.
OpenVINO ecosystem framework support:
HuggingFace
• OpenVINO space in HuggingFace – FP16, INT8 and INT4 preconverted models ready for deployment!https://huggingface.co/OpenVINOO
• Option 1: Use OpenVINO GenAI to run models from HuggingFacehttps://docs.openvino.ai/2024/learn-openvino/llm_inference_guide/genai-guide.html.
• Option 2: Use Optimum-Cli to run models from HuggingFacehttps://docs.openvino.ai/2024/learn-openvino/llm_inference_guide/llm-inference-hf.html.
ONNX
• Option 1Conver ONNX model to OV format (IR)https://docs.openvino.ai/2024/openvino-workflow/model-preparation/convert-model-onnx.html.
• Option 2: Use ONNX models thru OpenVINO ONNX Execution Providerhttps://onnxruntime.ai/docs/execution-providers/OpenVINO-ExecutionProvider.html.
Pytorch
• Option 1: Convert pytorch model to OpenVINO format (IR) (recommended for best performance)https://docs.openvino.ai/2024/openvino-workflow/model-preparation/convert-model-pytorch.html.
• Option 2: Use pytorch models with Torch.compilehttps://docs.openvino.ai/2024/openvino-workflow/torch-compile.html.
LangChain
• Example of LLMs inference with LangChain and OpenVINOhttps://python.langchain.com/docs/integrations/llms/openvino/.
• Reference RAG implementation with OpenVINO and LangChainhttps://docs.openvino.ai/2024/notebooks/llm-rag-langchain-with-output.html.
LlamaIndex
• Example of LLMs inference with LlamaIndex and OpenVINOhttps://docs.llamaindex.ai/en/stable/examples/llm/openvino/.
• Reference RAG implementation with OpenVINO and LlamaIndexhttps://docs.openvino.ai/2024/notebooks/llm-rag-llamaindex-with-output.html.
Pytorch 2.5 support for Intel GPUshttps://pytorch.org/blog/intel-gpu-support-pytorch-2-5/.
AI PC Dev Kitshttps://www.intel.com/content/www/us/en/developer/topic-technology/ai-pc/dev-kit.html.
AI Playgroundhttps://github.com/intel/AI-Playgroundd
GIMP on Intel® Core™ Ultra Mobile Processohttps://www.intel.com/content/www/us/en/developer/articles/tool/enable-ai-for-gimp-core-ultra-mobile-processors.html...
About Intel Software:
Intel® Developer Zone is committed to empowering and assisting software developers in creating applications for Intel hardware and software products. The Intel Software YouTube channel is an excellent resource for those seeking to enhance their knowledge. Our channel provides the latest news, helpful tips, and engaging product demos from Intel and our numerous industry partners. Our videos cover various topics; you can explore them further by following the links.
Connect with Intel Software:
INTEL SOFTWARE WEBSIhttps://intel.ly/2KeP1hDP1hD
INTEL SOFTWARE on FACEBOhttp://bit.ly/2z8MPFFMPFF
INTEL SOFTWARE on TWITThttp://bit.ly/2zahGSnhGSn
INTEL SOFTWARE GITHhttp://bit.ly/2zaih6zih6z
INTEL DEVELOPER ZONE LINKEDhttp://bit.ly/2z979qs79qs
INTEL DEVELOPER ZONE INSTAGRhttp://bit.ly/2z9XsbyXsby
INTEL GAME DEV TWIThttp://bit.ly/2BkNshuNshu
#intelsoftware #innovation
Empowering AI PC’s with Intel’s AI Software Stack | Tech Talk | Innovation Selects | Intel Software