October 24, 2022 | Detroit, Michigan
View More DetailsRegistration Information

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon North America 2022 - Detroit, MI + Virtual and add this Co-Located event to your registration to participate in these sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in Eastern Daylight Time (EDT), UTC -4. To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date."

The schedule is subject to change.
Back To Schedule
Tuesday, October 25 • 9:50am - 10:20am
WebAssembly Based AI as a Service on the Edge with Kubernetes - Rishit Dagli, Narayana Junior College; Incoming University of Toronto & Shivay Lamba, Meilisearch

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
WebAssembly (WASM) is being adopted at an increasing rate for edge applications. That allows WASM runtimes, such as WasmEdge (a lightweight and high-performance runtime for cloud-native, edge, and decentralized devices), to run serverless functions on the edge. Following the large-scale adoption and benefits of serverless computing, we focus on deploying these as a Function-as-a-service on edge devices. Machine Learning inference is often a computationally intensive task and edge applications could greatly benefit from the speed of WebAssembly. Unfortunately, Linux containers end up being too heavy for such tasks. Demonstrating Machine Learning deployments in such a fashion, another problem we face is that the standard WebAssembly provides very limited access to the native OS and hardware, such as multi-core CPUs, GPUs, or TPUs which is not ideal for the systems we target. The talk also shows how one could use the WebAssembly System Interface (WASI) to get security, portability, and native speed for ML models. To top it off this talk ends with a demo of deploying a Machine learning model as a serverless function using WASM deployed on an edge device.

avatar for Rishit Dagli

Rishit Dagli

CS Undergrad, University of Toronto
Rishit Dagli is a CS Freshman at The University of Toronto. He loves working with Machine Learning, especially Computer Vision and Kubernetes. He is an active contributor to multiple open-source projects like TensorFlow, KubeFlow, and Kubernetes. He also loves building open-source... Read More →
avatar for Shivay Lamba

Shivay Lamba

Developer Advocate
Shivay Lamba is a software developer specializing in DevOps, Machine Learning and Full Stack Development. He is an Open Source Enthusiast and has been part of various programs like Google Code In and Google Summer of Code as a Mentor and has also been a MLH Fellow. He is actively... Read More →

Tuesday October 25, 2022 9:50am - 10:20am EDT
Room 250 ABC Huntington Place: 1 Washington Blvd, Detroit, MI 48226