Open Source Summit + AI_dev Japan 2024

This talk explores groundbreaking methods for enhancing cross-platform AI workloads within container ecosystems. The focus will be on integrating the WebGPU standard into containers, enabling them to utilize host GPUs and other AI accelerators through a flexible API. This approach eliminates the need for creating container images specific to individual GPU vendors and their proprietary drivers. Explore 1. How the WasmEdge project leverages the WebGPU standard to develop portable LLM inference applications in Rust. 2. How containers can efficiently manage and orchestrate these applications, simplifying AI deployment across diverse environments.

This is an updated version of my previous CFP for OSS Summit EU. I will add deeper analysis of unique supply chain issues of Japan and SBOM best practice of Japanese companies. It would be a special insight of current SBOM practice of Japan. I believe this is a best topic to be discussed at OSS Summit Japan. Three years have passed since the issuance of the U.S. Executive Order (EO #14028), the adoption of SBOM in Japan has gradually progressed. Japanese companies are learning the minimum elements of SBOM which was published by NTIA, and are converting to a development process that takes automated SBOM generation into account. In July 2023, the Ministry of Economy, Trade, and Industry (METI) published a guide on the introduction of SBOM for software management, then the second version is scheduled to be released this summer. In this session, Ayumi Watanabe, a Japanese SBOM evangelist and an advisor to METI's SBOM PoC project, will discuss the status of SBOM in Japan, including the content of METI's guidelines, and the maturity and challenges of SBOM implementation in Japanese companies.

Security is paramount in today's online world. To enhance security, most small routers have a read only operating system and read write storage for configurations and general storage. Adding functionality usually requires uploading new firmware to the device which can be costly in both data charges and time. Wouldn't it be great to be able to maintain the security of a read only filesystem, but still be able to install new features? Containers are isolated from the host system, maintaining security, but are able to be installed in the read write portion of storage, or even run completely in RAM. The problem with containers is the resource requirements just to run said container. In this talk, we will demonstrate how a minimal, but fully functional container subsystem can be run on a small, resource constrained embedded device. We will show how containers enable edge computing where the user can run their own software on the device without compromising security, or needing to integrate their application with the host operating system. Containers can turn even the meekest of devices into an edge computing powerhouse!

Telco operators/SPs are going through a massive transformation. This includes the imperative of DT & softwarization (SDN, NFV & cloud). While de-facto std. developing orgs. dominated the stds. space for telcos for years, lately we've seen the open source (OS) projects taking the lead in many of the nwk virtualization, automation, orchestration & telco cloud-related activities. As more control & programmability are abstracted towards SW layers in the telco stack, the use of cloud-native (CN) tech & tools has become unavoidable. But, unlike the OS communities, vendors, or enterprises, the telco adoption of OS and CN is much slower due to multiple reasons. These include cultural, educational & organizational challenges. I'd like to openly discuss these challenges & propose some solutions so that we all can collaborate to accelerate the OS and CN adoption in the Telco domain. My objective is to make OS and CN general & universal in the Telco domain for all operators/SPs, especially in developing economies.

The xz-utils vulnerability has attracted attentions from every person who are involved in not only open-source software but also any form of software that is built with a collaboration of developers. The vulnerability, or rather the social engineering attack has combined multiple attack techniques: maintainer takeover, obfuscated trigger code, and binary files pretending sample archives, and targeted Linux distributions, which are fundamental in the current software supply chain. In this session, Taku aggregates multiple existing analyses about the vulnerability, and explains how the attack was performed with a progress of the incident as well as technology details of the malicious source code and binary. Taku also presents a potential risk of similar incidents in open-source repositories by using some utilities including OpenSSF’s Scorecard and Criticality Score. This session would suggest what kind of attacks would come next for the software industry and would be mitigated or coped with.

Edge computing is an important technology for a data-driven society that makes decisions in real time from data. LF Edge, a project of The Linux Foundation, is working to establish an open and interoperable edge computing framework that is independent of hardware, processor, cloud, and OS. LF Edge is also focused on enabling edge AI because of the growing need for real-time AI processing. However, there are challenges to achieving an infrastructure that is both energy efficient and flexible, such as increasing data volumes, increasing the computational complexity of AI models, and meeting application-specific requirements. So we need innovation in infrastructure technology. Therefore, The Linux Foundation and THE IOWN GF signed a basic agreement in June 2023 to integrate the Linux Foundation’s software on the infrastructure proposed by IOWN GF to develop a common infrastructure that improves performance, reduces latency, and improves energy efficiency. Based on this agreement, we planned the IOWN GF/LF Edge Joint PoC to demonstrate the convergence of the two technologies and the performance improvements. This presentation describes the content of the PoC.

Container image vulnerabilities pose significant security challenges. While tools like Grype and Trivy identify issues, efficient remediation remains a hurdle. Enter Copa, a groundbreaking CNCF project designed to automatically patch vulnerabilities within container images. Copa enables swift OS-level vulnerability remediation without upstream rebuilds, crucial for complex supply chains and third-party sources with delayed updates. It works with existing vulnerability scanners to streamline patching processes, reducing complexity and turnaround time. In this session, we’ll explore Copa’s integration with current workflows, its ability to patch images without requiring specific customizations, and support for containers without package managers, including distroless containers. Attendees will learn how Copa empowers DevSecOps teams to deploy secure containers faster and with greater confidence, minimizing exposure to potential threats. Join us to discover how Copa transforms container security, making automated patching accessible and effective for all practitioners.

This LinuxCon presentation explores recent advancements in the Linux VFIO, IOMMU, and PCI subsystems, crucial for device passthrough and virtualization. It delves into the evolution of VFIO, covering improvements in device assignment, mediated devices, and user-space drivers. IOMMU's role in device isolation and security is examined, highlighting new features and best practices. The PCI subsystem's hotplug capabilities, resource optimizations, and emerging standards like SR-IOV are discussed. Real-world use cases and demonstrations showcase these technologies in cloud gaming, HPC, and embedded systems. Attendees will gain deeper understanding and learn about cutting-edge developments, fostering collaboration and driving the advancement of device passthrough in the Linux ecosystem.

"Decoding Serverless and FaaS: Knative vs. OpenFaaS vs. Kubeless vs. Pulumi" delves into the complexity of serverless computing and highlight the strengths of today’s most compelling open-source tools. We’ll dive deep into Knative’s seamless Kubernetes-native integration that automates scaling and manages workloads effortlessly, OpenFaaS’s intuitive interface that empowers developers to deploy multi-language functions, Kubeless’s straightforward approach to deploying functions as Kubernetes objects, and Pulumi’s innovative infrastructure as code that merges serverless capabilities with familiar programming languages. We will also compare these tools in real-world scenarios, providing clear guidance on when and why to choose each one based on specific project needs and operational goals. Whether you’re looking to streamline microservices, handle event-driven workloads, or simply enhance your development efficiency, this talk will provide you with the insights and practical comparisons you need to choose the right tool for your serverless journey. Let’s navigate the future of serverless together and empower our next big project!