SYNAPSE is a Medium Rare template.
Explore more great templates for Webflow, Framer + Figma.

GOSIM Schedule
Sept 26th

Schedule

AI

Open AI definition, governance, use cases, Infra, and LLM projects

8:00 am

Registration

Registration

9:00 am

GOSIM: Embracing the AI New Era with a Global Perspective

GOSIM: Embracing the AI New Era with a Global Perspective

Tao Jiang

9:15 am

Advancing Kubernetes Resource Scheduling, Isolation and Management

Advancing Kubernetes Resource Scheduling, Isolation and Management

In the dynamic world of cloud-native applications, Kubernetes has emerged as the cornerstone of container orchestration. But, as our infrastructures grow and evolve, so do the complexities of managing and isolating resources effectively. This keynote will shed light on resource management to bolster Kubernetes' resource scheduling, isolation, interfacing, and efficiency capabilities. Also, we'll show our efforts and innovations in the broader cloud-native domain to provide a broader perspective on our endeavors in the cloud-native space.
Grace Lian

9:30 am

Arm's Commitment to Open-Source Innovation

Arm's Commitment to Open-Source Innovation

In the opening keynote, Arm will outline how it’s commitment to open collaboration across the global open-source community is enabling millions of developers to test and build and build their applications on a strongly curated Arm architecture. This includes support for developers to take advantage of new, advanced AI workloads through increasing machine learning capabilities on Arm-based hardware via open-source frameworks and libraries, and support for thousands of open-source projects across all technology market segments so developers have the tools and capabilities to write easier, simpler, faster, and more secure software on Arm.

Thomas Molgaard

9:45 am

Open Source Community+GOSIM

Open Source Community+GOSIM

Emily Chen

10:00 am

Morning Break

Morning Break

10:15 am

How Arm is Empowering Developers to Unleash AI Everywhere

How Arm is Empowering Developers to Unleash AI Everywhere

The keynote will outline Arm’s commitment to the developer ecosystem to enable “AI everywhere”, so the AI-based application experiences coming to market now and in the future work seamlessly on Arm, the most pervasive AI compute platform in the world. We’ll explain how Arm’s foundational technology and supporting tools will empower the millions of developers worldwide to deliver the rich experiences that users are demanding, while allowing them to write easier, faster, more secure software on the Arm compute platform. The keynote will then showcase Arm's solutions to enable AI everywhere.
Liliya Wu
Zach Zhao

10:45 am

Efficient Techniques For Super-Large AI Models Training and Deployment

Efficient Techniques For Super-Large AI Models Training and Deployment

The Transformer architecture has improved the performance of deep learning models in domains such as Computer Vision and Natural Language Processing. Together with better performance come larger model sizes. This imposes challenges to the memory wall of the current accelerator hardware such as GPU. It is never ideal to train large models such as Vision Transformer, BERT, LLaMA, and GPT on a single GPU or a single machine. There is an urgent demand to train models in a distributed environment. However, distributed training, especially model parallelism, often requires domain expertise in computer systems and architecture. It remains a challenge for AI researchers to implement complex distributed training solutions for their models. To solve this problem, we introduce a unified parallel training system designed to seamlessly integrate different paradigms of parallelization techniques including data parallelism, pipeline parallelism, multiple tensor parallelism, and sequence parallelism. Our system aims to support the AI community to write distributed models in the same way as how they write models normally. This allows them to focus on developing the model architecture and separates the concerns of distributed training from the development process. Our system is able to achieve 2x speedup over state-of-the-art distributed systems for GPT model training.
Yang You

11:15 am

Huggingface Big Code Project

Huggingface Big Code Project

BigCode is a collaborative initiative dedicated to developing large language models for coding. Its mission is to foster transparency and enhance data governance in AI and software engineering by bridging the gap between open-source and closed-source models. A key achievement includes the release of the vast Stack dataset, which houses a significant collection of GitHub repositories. One standout product from BigCode is StarCoder, a multilingual code model. StarCoder stands out with its 15.5B parameters, trained on a massive 1 trillion tokens, with a context length of 8k. Not only does it excel in Python and various other languages, but it also offers advanced features like infilling, swift large-batch inference, and responsible AI integrations.
Loubna Ben Allal

11:45 am

Applications of Fine-tuning Large Models In Specific Vertical Domains

Applications of Fine-tuning Large Models In Specific Vertical Domains

This presentation will focus on the commercial applications of fine-tuning large models in specific vertical domains. Firstly, we will explore the current trends of large models in the business sector and the importance of fine-tuning in vertical domains. We will also highlight the challenges enterprises might face during this process, such as data acquisition and processing, customization requirements, and technical resource constraints. In response to these challenges, we will demonstrate how we assist enterprises, including our team's background, experience, customized fine-tuning services, and subsequent technical support.
Bosheng Ding

12:15 pm

Lunch Break

Lunch Break

1:45 pm

Panel Discussion: LLM Vertical User Case

Panel Discussion: LLM Vertical User Case

Host

Emily Chen

Panelists:

  • Qing Wei : Microsoft China CTO
  • Yuan Wang : General Manager of NetEase Shufan
  • Zhongyi Tan : Founder of Xingce Community and Chairman of Open Atoms TOC
  • Zhenan Xu : CTO of Medical Technology

Emily Chen

2:45 pm

Insights into Global Advancements and Future of Foundational Large Models

Insights into Global Advancements and Future of Foundational Large Models

In recent years, the emergence of foundational large models has significantly raised the performance ceiling of AI systems across various intelligent tasks. How to effectively explore and utilize them has become a topic of keen interest. As the Chief Researcher of Mianbi Intelligence, the speaker will provide a high-density, high-quality academic presentation on the forefront of large models. This talk will not only comprehensively introduce the main technical characteristics and features of current foundational large models, covering the latest research advancements both domestically and internationally in areas like model training, multilingual cognition, multimodal perception, and tool intelligence; but also delve deeply into the future development directions and application prospects of foundational large models, analyzing the value and potential they hold in real-world applications.
Xu Han

3:15 pm

BigDL-LLM: Low-Bit LLM Library on Intel CPU and GPU

BigDL-LLM: Low-Bit LLM Library on Intel CPU and GPU

This talk will introduce bigdl-llm, an open source library for running LLM (language language model) on Intel laptops and GPUs using low-bit optimizations (INT3/INT4/NF4/INT5/INT8) with very low latency. It is built on top of various technologies (such as llama.cpp, gptq, bitsandbytes, qlora, etc.) and optimized on Intel CPU/GPU. With bigdl-llm, the users can build and run LLM applications on Intel laptops, using standard PyTorch APIs (e.g., Hugging face Transformers and LangChain); a wide range of models (such as LLaMA/LLaM2, ChatGLM/ChatGLM2, MPT, Falcon, MOSS, Baichuan, QWen, Dolly/Dolly-v2, RedPajama , StarCoder , Whisper, etc.) have already been verified and optimized on bigdl-llm.
Yuwen Hu

3:45 pm

Afternoon Break

Afternoon Break

4:00 pm

AIGC on the Mobile: Towards Ultimate Efficiency in Deep Learning Acceleration

AIGC on the Mobile: Towards Ultimate Efficiency in Deep Learning Acceleration

Mobile and embedded computing devices have become key carriers of deep learning to facilitate the widespread use of machine intelligence. However, there is a widely recognized challenge to achieve real-time DNN inference on edge devices, due to the limited computation/storage resources on such devices. Model compression of DNNs, including weight pruning and weight quantization, has been investigated to overcome this challenge. However, current work on DNN compression suffers from the limitation that accuracy and hardware performance are somewhat conflicting goals that are difficult to satisfy simultaneously. We present our recent work Compression-Compilation Codesign, to overcome this limitation towards the best possible DNN acceleration on edge devices. The neural network model is optimized in a hand-in-hand manner with compiler-level code generation, achieving the best possible hardware performance while maintaining zero accuracy loss, which is beyond the capability of prior work. We are able to achieve real-time on-device execution of a number of DNN tasks, including object detection, pose estimation, activity detection, speech recognition, just using an off-the-shelf mobile device, with up to 180 X speedup compared with prior work. Recently, for the first time, we enable large-scale language and AIGC models such as GPT and Stable Diffusion on mobile devices. Last we will introduce our recent breakthrough of superconducting logic based neural network acceleration that achieves 10^6 times energy efficiency gain compared with state-of-the-art solutions, achieving the quantum limit in computing.
Yanzhi Wang

4:30 pm

Building Novel LLM Open Source Ecosystem with MindSpore and Ascend

Building Novel LLM Open Source Ecosystem with MindSpore and Ascend

With the witness of open-source LLMs such as LLaMA booming this year, developers and the industry have focused on building an effective LLM open-source ecosystem. Publicly released weight files and open-source deep learning frameworks are currently the core component of such an ecosystem. However, it is not without its limitations. In this talk, we will introduce our open-source deep learning framework MindSpore, the open ecosystem of Ascend Computing Platform, and how we are building a novel LLM ecosystem with high-quality offerings
Zhipeng Huang

5:00 pm

Panel Discussion: Open Al definition, license, governance issues and best practice

Panel Discussion: Open Al definition, license, governance issues and best practice

Panelists:
  • Yuhao Jiang: Legal Affairs Department of Microsoft Asia-Pacific Research and Development Group
  • Zhenhua Sun: ByteDance Open Source Committee Legal Advisor
  • Wei Meng : Head of Open Source at ZTE Communication, Chairman of the LF AI & Data Board of Directors
  • Tiandong Liu (Ted): co-founder of Open Source Society, ASF member, and consultant for Open Source Rainforest.
  • Zhongyi Tan: ASF member, LF AI & Data TAC member, chairman of the Technical Oversight Committee (TOC) of the Open Atom Foundation, and senior architect at 4Paradigm.

Anni Lai
Schedule

Rust Language

Next generation programming language.

8:00 am

Registration

Registration

9:00 am

Sponsor + GOSIM Keynotes

Sponsor + GOSIM Keynotes

10:00 am

Morning Break

Morning Break

10:15 am

Plans for the Long Future of Rust

Plans for the Long Future of Rust

Rust plans to be around and thriving for many decades to come. What do programming languages look like when they have evolved for decades? In this talk, I'll show some examples from the very small set of languages that have stood the test of time, how much they've changed, and how much of their essential character they've retained. Using that as a basis, I'll take a look at some of the problems Rust could face in the next few decades, and speculative larger changes Rust could make to address those challenges. Does Rust want to span the entire breadth of programming needs, or cede portions of that space to other languages, past or future? What would we gain, and lose, by being a universal programming language? Rust has largely avoided having different "dialects" of the language; Rust is the same language for every user. I'll talk about the benefits we gain from this requirement, and the drawbacks. What would happen if we questioned this assumption, and considered having interoperable but distinct variants of Rust for different users? And to what extent have we already done so, with editions, unsafe, no_std, and async?
Josh Triplett

10:45 am

Rust Compiler Overview

Rust Compiler Overview

This talk will provide an overview of the Rust compiler: what it looks like, how it works, how its internals are structured, and how it is developed.
Nicholas Nethercote

11:15 am

NTP for the modern era

NTP for the modern era

Time synchronization is a crucial but often overlooked component of the internet. In this talk you will learn how time synchronization works, and how our Rust implementation of the network time protocol keeps the internet in sync.
Folkert de Vries

11:45 am

Rust Linux Project

Rust Linux Project

Rust for Linux is an ongoing effort to introduce Rust code into the Linux kernel. The kernel is different from ordinary software projects; unique requirements make programming kernel in Rust extremely challenging. In this talk I will introduce the history and status of the Rust for Linux project, and share challenges that we have encountered when adapting Rust to kernel requirements. I will also go over unresolved issues, and unstable features or potential enhancements in the Rust compiler and language that could pave the path forward.
Gary Guo

12:15 pm

Lunch Break

Lunch Break

1:45 pm

The University Lever: Raising Rust In School

The University Lever: Raising Rust In School

In the early 1980s, I watched UNIX take off. A huge part of that rise was AT&T giving its UNIX source code to universities to run and play with. Students learned how to use and adapt UNIX, and over time rewrote most of it. Other companies have tried over the last 40 years to repeat this success. Apple, Next, Sun and and others launched large, expensive efforts to make universities the base for spreading their new tech. These efforts were less effective. Indeed, the rise of Free and Open Source software turned things around a bit: FOSS projects such as Linux started in universities and elsewhere had a big effect on industry. Today the Rust programming language is rapidly rising in use and attention in a highly competitive environment. Can getting Rust into the hands of university students and faculty help Rust reach the top? I think it can. In this talk, I outline some necessary steps to university adoption of Rust, and point out some traps to avoid. My analysis focuses on the synergies between universities, industry and open source. I propose a model in which university folks play a natural key role in adapting Rust to be easier to learn, improving Rust as a language, and training students to use Rust to be more effective software developers in specific domains.
Bart Massey

2:15 pm

Rust Infrastructure Mirror In China

Rust Infrastructure Mirror In China

Reighter is a tool for building Rust proxies and private crate mirrors, aiming to assist the community and companies in developing Rust projects. It can act as a proxy for crates.io and provides a private crate registration feature to ensure that developers can only use company-approved crates. It also supports the requirements of upgrading and repairing private crates. Freighter also possesses the capability to index public crates and synchronize with crates.io, allowing files to be stored on local disks or storage services like S3. Additionally, it offers an analysis engine for public crate ratings, along with blacklist and whitelist features for DevOps.
Tianxing Ye

2:45 pm

Rust Programming Language and Operating Systems - Can Rust challenge C's status in OS?

Rust Programming Language and Operating Systems - Can Rust challenge C's status in OS?

This report introduces the history and development of programming languages and their influence on operating system kernels; analyzes the challenges faced by operating system kernels at the language level and solutions; introduces Rust's impressions on operating systems in terms of its type system, security, etc.; and finally discusses practices and explorations on architectures, components and related characteristics of developing operating system kernels based on various mechanisms of the Rust language.
Yu Chen

3:15 pm

Rust Community In China

Rust Community In China

As a seasoned Rust enthusiast who started learning Rust in 2015, evangelized the community, and later provided Rust consulting for businesses, I will share my perspective on how the Rust language has taken root and sprouted in China over the past eight years.
Alex Zhang

3:45 pm

Afternoon Break

Afternoon Break

4:00 pm

Rust RPC Framework Volo Performance Optimization Practice

Rust RPC Framework Volo Performance Optimization Practice

The performance overhead in the RPC framework is mainly concentrated in the two parts of serialization and network communication. In this lecture, I will mainly introduce how Volo optimizes the performance of these two parts. The serialization part includes compilation optimization, memory Zero copy, etc., the network communication part includes shmipc shared memory communication, etc.
Jie Liu

4:30 pm

Use Rust To Automate The Linux Distribution Build Process And Create A Custom Distribution

Use Rust To Automate The Linux Distribution Build Process And Create A Custom Distribution

This presentation will explore how to use Rust to automate the Linux distribution build process. The presentation will include the benefits of using LFS, which allows highly customizable and lightweight Linux distributions. The presentation will also introduce the custom distribution build process, building a Linux kernel that supports Rust, and adding software that uses Rust for operating system development. Finally, the presentation will demonstrate the use of the build tools and the booting of the custom distribution. Participants will gain a deeper understanding of using the Rust programming language and how to build a new Linux distribution from scratch.
Xiaoyu JIa

5:00 pm

Rust Panel Discussion

Rust Panel Discussion

Schedule

Mobile & Web

High performance, cross platform, app and web development

8:00 am

Registration

Registration

9:00 am

Sponsor + GOSIM Keynotes

Sponsor + GOSIM Keynotes

10:00 am

Morning Break

Morning Break

10:15 am

Unleash The Potential of Every Mobile Device Through Open Mobile Hub

Unleash The Potential of Every Mobile Device Through Open Mobile Hub

The current mobile industry is dominated by two big players, whose platforms account for 99% of all smartphones sold. Global regulators are increasingly writing new regulations to foster a more competitive mobile market. With all the latest developments in the mobile industry there are major advantages to have an open mobile ecosystem. It will increase innovation, make collaboration more efficient, encourage industry standards and interoperability, and help everyone in the ecosystem adapt to evolving markets and changing environments. Open Mobile Hub (OMH) is an open source SDK supporting an unified code base for both GMS and non-GMS devices. OMH is designed with a plugin architecture supporting developers in their apps development across diverse mobile environments to deliver UX consistency and cross-platform support.
Preston Lau

10:45 am

Makepad for Mobile, Desktop and Web Apps

Makepad for Mobile, Desktop and Web Apps

We are building Makepad, an MIT licensed GPU shader accelerated UI kit for Rust, paired with our own IDE that includes a code editor and visual design tool. In this talk i will show some of the tools we have been developing, and fun examples including mobile applications and a synthesizer.
Rik Arends

11:45 am

An Open Mobile Ecosystem with Trust and Interoperability

An Open Mobile Ecosystem with Trust and Interoperability

Following the remarkable global success of mobile devices and ecosystems, there has been a concerning emergence of fragmented realities within these ecosystems. Such fragmentation hampers innovation and stifles the emergence of transformative products and services. In this talk, Wenjing will introduce the latest technologies, standards and open-source development that lead the way to overcome this challenge. As a leading expert in defining the Trust Spanning Protocol and the OpenWallet Foundation open-source community, Wenjing will share the vision and the technical foundation for a new era of open mobile ecosystem, unleashing a new wave of innovations and applications.
Wenjing Chu

12:15 pm

Lunch Break

Lunch Break

1:45 pm

Write Once, Run Everywhere: Building Apps With Dioxus

Write Once, Run Everywhere: Building Apps With Dioxus

Building cross-platform apps has never been easy. Very few libraries make it possible to target the web, desktop, and mobile with codebase. In this talk, we’ll cover how Dioxus makes it easy for developers to write an app once in the Rust programming language and ship it to any platform. Throughout the talk, we’ll dive into concepts like state management, performance, modularity, and how Rust is rethinking modern app development.
Jonathan Kelley

2:45 pm

Servo: A Web View From Somewhere Else

Servo: A Web View From Somewhere Else

The previous decade has seen a great decrease in the diversity of web engines and the consolidation of the browser industry into a small number of vendors. The consensus that the web platform is built on open standards and open-source software allows the participation of third parties, within limits. Meanwhile, the importance of the web platform has grown and it has become an essential building block in an increasing amount of technology stacks. Those who embed web engines or would like to give their users a full-featured web browser seek a path through these contradictions. Servo is an experimental web engine under the umbrella of the Linux Foundation. Harnessing the "fearless concurrency" and memory safety of Rust and the simpler code base of a greenfield implementation, it offers the possibility of a nimbler and more distributed evolution of the web platform.
Martin Robinson

3:45 pm

Afternoon Break

Afternoon Break

4:00 pm

Osiris Project, OS Interfaces for Rust Applications

Osiris Project, OS Interfaces for Rust Applications

While most application frameworks put emphasis on their user interface abstractions, an immersive application experience requires neatless integration into each target platform. Let's look beyond UI, at the requirements application developers have, what popular non-Rust application frameworks provide, and how we intend to improve the situation for Rust applications.
David Rheinsberg

4:30 pm

Robius: A Vision for Multi-Platform App Development in Rust ?

Robius: A Vision for Multi-Platform App Development in Rust ?

Developers frequently ask how they can create multi-platform applications in Rust, hoping to leverage Rust’s safety, performance, and robust ecosystem for a painless app dev experience. However, while Rust excels in systems programming environments, its app dev ecosystem is fragmented and not yet well-established or mature, particularly on mobile platforms. This talk will highlight our vision to establish an open-source community and drive collaboration among major contributors in the space of cross-platform Rust app frameworks. Specifically, we will dive into the motivation and goals of this vision, its technical requirements, and our implementation plans for a full-system reference design. Ultimately, we aim to realize a turnkey solution that enables developers of all experience levels to easily create robust, modern Rust apps on any platform.
Kevin Boos

5:00 pm

Mobile Rust Panel Discussion

Mobile Rust Panel Discussion

Schedule

Auto & Robotics

Software defined vehicle, autonomous driving and robotics

8:00 am

Registration

Registration

9:00 am

Sponsor + GOSIM Keynotes

Sponsor + GOSIM Keynotes

10:00 am

Morning Break

Morning Break

10:15 am

Construction of Vehicle-to-Cloud Ecosystem Based on Open Source Vehicle-Cloud Integrated Architecture

Construction of Vehicle-to-Cloud Ecosystem Based on Open Source Vehicle-Cloud Integrated Architecture

With the development of automobile intelligence and electrification, traditional automotive value chains and technical stacks are undergoing reconstruction. The trend is shifting towards "hardware convergence, software definition, and data-driven". Software in automobiles is increasingly becoming a key element for car manufacturers to create differentiated products, establish new ecosystems, and "reduce costs and increase efficiency". To achieve cost reduction and efficiency, the evolution from Intelligent Driving OS to Whole Vehicle OS and then to the integrated Vehicle-to-Cloud OS is imperative. Under the open-source architecture and development roadmap, the intelligent vehicle ecosystem of Vehicle-to-Cloud will connect with other ecosystems such as "Energy-Road-Cloud" and will trigger a new round of industrial ecosystem revolution. This will further promote innovations in energy ecology, smart cities/smart vehicles, and computational center ecosystem.
Jin Shang

10:45 am

Challenges and Practices in the Commercialization of Intelligent Driving

Challenges and Practices in the Commercialization of Intelligent Driving

Intelligent driving is a major revolution in the field of auto industry and traffic travel. By replacing drivers and liberating the limbs and brains of human beings, it has posed challenges to the current vehicle management and driver supervision system across the board. In the past few years, all the main auto producers are committed to accelerating the pace of institutional innovation, eliminating obstacles in road test verification and industrialization, and gradually paving the way for commercialization of intelligent driving. But the implementation date of autonomous driving repeated delays. It is still insufficient in vehicle standards, open road test norms, relevant laws and regulations, network and data security as well as supporting systems to avert risks. Changan automobile promote the vehicle management and responsibility step by step with auto driving as the destination. This presentation will base on the analysis of intelligent driving challenges, propose our solutions and share some practical results.
Nan Dong

11:15 am

Advances on Large Models and Applications in Autonomous Driving

Advances on Large Models and Applications in Autonomous Driving

The goal of autonomous driving is to improve the ultimate driving performance. However, in the widely used modular engineering, tasks are broken down independently, making it difficult to transmit rich high-dimensional information and ensure high driving performance. Conventional end-to-end autonomous driving networks lack interpretability, so it is crucial to reasonably construct multi-task autonomous driving as an end-to-end network. Therefore, we propose an end-to-end autonomous driving solution guided by the final task (i.e. route planning) and jointly optimized by multiple modules. It can fully leverage the systematic advantages of data-driven systems to achieve the optimal solution by combining perception, prediction, and decision-making tasks. For more details, please visit https://opendrivelab.com
Hongyang Li

11:45 am

The Convergence of Robotics and Cloud-Native: Accelerating the Development of Intelligent Robot Applications

The Convergence of Robotics and Cloud-Native: Accelerating the Development of Intelligent Robot Applications

The fusion of robotics technology and cloud-native technology has garnered extensive attention in recent years. With the continuous growth of the robotics market and the trend towards intelligentization in the robotics industry, cloud-native robotics has become an important means to achieve robot intelligence and accelerate the development of robot applications. This topic will venture into the challenges faced by the robotics industry and the challenges of ROS in achieving intelligence, highlighting the pain points of the current robotics industry. Subsequently, the focus will be on the introduction of a cloud-native robot system based on kubeedge, exploring its application in cloud-native robot systems and how it provides support for constructing intelligent robot applications. Finally, this topic will illustrate the logic of using cloud-native robot technology in practical scenarios, using the example of developing a cloud-native robot park inspection application with edge-cloud collaboration.
Jiezhang Wang

12:15 pm

Lunch Break

Lunch Break

1:45 pm

SPEAR: A Simulator for Photorealistic Embodied AI Research

SPEAR: A Simulator for Photorealistic Embodied AI Research

Interactive simulators are becoming powerful tools for training embodied AI agents, but existing simulators suffer from limited content diversity, physical interactivity, and visual fidelity. In this talk, I will discuss the ongoing efforts in my research group to address these limitations. More specifically, I will discuss a new open-source simulator we are developing called SPEAR - A Simulator for Photorealistic Embodied AI Research. To develop SPEAR, we worked extensively with team of professional artists to construct several highly realistic virtual indoor environments with thousands of unique objects that can be manipulated individually. Our environments are implemented as Unreal Engine assets, and we provide a high-level Python interface for interacting with robots in our environments. Throughout the talk, I will provide an overview of the current functionality in SPEAR, show example applications, and discuss the roadmap for our upcoming v0.4.0 release and beyond. SPEAR is available online at https://github.com/isl-org/spear.
Mike Roberts

2:15 pm

Research on Integrated System for Real-time Traffic Perception in Smart Campus

Research on Integrated System for Real-time Traffic Perception in Smart Campus

Research on Integrated System for Real-time Traffic Perception in Smart Campus Real-time traffic perception empowers physical entities with autonomous identities and information exchange abilities. To achieve the traffic perception of overall area, we have developed an integrated system dedicated to roadside traffic perception in smart campus. This system can perceive all traffic participants in the roadside environment and create a digital representation that enables real-time monitoring, analysis, and interaction with physical entities. However, constructing such a traffic perception system has many challenges of tedious sensor calibration, limited perception accuracy, and ineffective data utilization. To address these challenges, we propose an automatic online sensor calibration method that utilizes inherent feature of the road environment or vehicle trajectory feature. And then, we introduce a geometry-based monocular 3D detection scheme for near-range perception, as well as a multi-modal bird's-eye view (BEV) fusion model and a target-based fusion method of MMW Radar and camera with a Radar-guided 2D matching strategy to achieve accurate detection for long-distance traffic perception. Additionally, considering the inherent characteristics of the data, we construct the data models and spatiotemporal indexes scheme to facilitate efficient storage and retrieval for traffic perception data. This presentation will focus on our research and exploration in the area of integrated system for real-time traffic perception in the smart campus.
Yanyong Zhang

2:45 pm

Autoware -- World's Leading Open-source Autonomous Driving Project

Autoware -- World's Leading Open-source Autonomous Driving Project

Autoware is the world's leading open-source software project for autonomous driving, based on Robot Operating System (ROS/ROS2) . It enables commercial deployment of autonomous driving in a broad range of vehicles and applications. The main purpose of establishing Autoware Foundation is encouraging as many individuals and organizations as possible to contribute to open innovations in autonomous driving technology. Leading by the Autoware Foundation, Autoware now has been built on a clear modular architecture and is highly customizable. It consists of all the functionality required for autonomous driving (i.e., perception, localization, planning, control) with clearly defined interfaces and APIs.
Yang Zhang

3:15 pm

Open Source Projects for Autonomous Driving

Open Source Projects for Autonomous Driving

CARSMOS (Cars' Mobility Operating System) aims to provide a technologically advanced, standardized, open-source platform to address the problems of platform closure and fragmentation in smart car research, education, and industry collaboration. This project cluster includes contributions, sponsorships, and participation from the industry, academia, and research. Through the implementation of these unified platform technologies, we can effectively cater to the fundamental requirements of smart car education and research. Furthermore, we anticipate that these platforms will serve as a means for benchmarking and fostering dialogue with the industry. This alignment will facilitate a closer integration between education, research, and industry needs, thereby expediting the transfer of research outcomes to practical applications in the industry.
James Yang

3:45 pm

Afternoon Break

Afternoon Break

4:00 pm

Dora-Drives: Autonomous Driving Made Simple

Dora-Drives: Autonomous Driving Made Simple

Currently most Open-Source Autonomous Driving Systems (ADS) use the relatively mature ROS (Robotics Operating System) or build their computing platforms based on ROS. However, ROS is based on ICT technologies 15 years ago, and modern ICT technologies, such as memory safety languages, low-cost development, and DevOps practices, have not yet been introduced. The DORA project (https://github.com/dora-rs) takes Software-Defined Vehicle (SDV) and ADS as its target scenarios, adopts memory-safe Rust language, cloud-native architecture, and ecosystem tools, supports elastic dataflow computing framework and diverse communication middleware options. At the same time, it also provides a technical route for upgrading, replacing, and surpassing ROS1/ROS2. DORA provides multiple programming language SDKs, currently providing Python, Rust, C/C++ SDKs. Especially the support for the Python API is treated as a first-class citizen. Because DORA supports shared memory, data copying is avoided as much as possible in dataflow interaction, and even applications developed in Python have good performance guarantees. DORA-DRIVES implements an end-to-end ADS example through DORA Python API, programmed through a low-code IDE, which can quickly test and verify ML models and algorithms (e.g., https://paperswithcode.com/, https://huggingface.co/) to quickly build prototypes of ADS for research and education. Proven ML models and algorithms can be introduced into the production environment of ADS through DORA C/C++/Rust API, and then the production environment provides feedback on new ML models and algorithms. Python API is used for research, education and rapid prototyping, and C/C++/Rust API is used for high-performance, low-latency, asynchronous and parallel production environments; the two are organically combined and complement each other to form a positive cycle.
Xavier Tao

4:30 pm

Dynamic Scenario Construction in Carla: Starting with Leaderboard

Dynamic Scenario Construction in Carla: Starting with Leaderboard

This presentation will combine the development experience of Carla Leaderboard to demonstrate how to use Carla and its related toolchain to construct dynamic testing scenarios. It will also discuss how to utilize existing scenes to design test routes in different regions and styles. Furthermore, it will delve into the design philosophy of Carla Leaderboard competitions and explore the gap between competition and industrial practice.
Songyang Yan

5:00 pm

Panel Discussion (SDV, Automous Driving, Robotics)

Panel Discussion (SDV, Automous Driving, Robotics)

Schedule

Game & Metaverse

WebXR, game engine and AIGC

8:00 am

Registration

Registration

9:00 am

Sponsor + GOSIM Keynotes

Sponsor + GOSIM Keynotes

10:00 am

Morning Break

Morning Break

10:15 am

The Augmented Conversation

The Augmented Conversation

Human communication mediated by computers and Spatial Computing devices will enable us to dynamically express, share and explore new ideas with each other via live simulations as easily as we talk about the weather. This collaboration provides a “shared truth” — what you see is exactly what I see, I see you perform an action as you do it, and we both see exactly the same dynamic transformation of this shared information space. When you express an idea, the computer, a full participant in this conversation, instantly makes it real for both of us, enabling us to critique and negotiate the meaning of it. This shared virtual world will be as live, dynamic, pervasive, and visceral as the physical.Spatial Computing is not just the next wave of collaboration and computing, it is a fundamental shift in how we will engage with our world and each other, and how we will understand and solve the huge problems we face as a species. AR will replace your PC, your phone, your tablet. It will be an always on and always on YOU supercomputer — it will amplify our intentions and ideas enabling all of us to create and explore new universes together.‍
David Smith

11:15 am

Wolvic: Web Browsing on Extended Reality

Wolvic: Web Browsing on Extended Reality

Web browsing on Extended Reality enables users to navigate and interact with traditional Web-based content, as well as immersive WebXR experiences. In this presentation, we will draw from our experience creating Wolvic, an open-source Web browser for XR devices. We will begin with an overview of current Web-based solutions for different use cases, from video and gaming to social collaboration and productivity. We will discuss the technical challenges and design opportunities of creating a Web browser for XR devices. Finally, we will look at the complexities of developing a multiplatform and open-source XR application.
Felipe Erias

12:15 pm

Lunch Break

Lunch Break

1:45 pm

Interoperability Standards Powering the Future Of Metaverse, 3d Graphics, XR & Vision Acceleration

Interoperability Standards Powering the Future Of Metaverse, 3d Graphics, XR & Vision Acceleration

Open standards play an important role in enabling interoperability, the bedrock of the metaverse, including deploying 3Dgraphics, XR, and vision-based systems at scale. In this session, Khronos Group'sDennis Fu will share an update on the family of Khronos Group standards that support the development of an open metaverse, including OpenXR, glTF, and others such as Vulkan and KamarosEmbedded Camera API Interoperability). The conversation will share an evolving roadmap for these standards and provide insights into which standards are relevant to attendee projects. Neil Trevett Khronos Group President and President of the Metaverse Standards Forum will sharean update on the progress and direction ofthe and highlight how attendees mayoarticipate in this important industryinitiative.
Dennis Fu

2:15 pm

Nerfstudio - A collaboration friendly studio for NeRFs

Nerfstudio - A collaboration friendly studio for NeRFs

Neural Radiance Fields (NeRF) are a rapidly growing area of research with wide-ranging applications in computer vision, graphics, robotics, and more. In order to streamline the development and deployment of NeRF research, we propose a modular PyTorch framework, Nerfstudio. Our framework includes plug-and-play components for implementing NeRF-based methods, which make it easy for researchers and practitioners to incorporate NeRF into their projects. Additionally, the modular design enables support for extensive real-time visualization tools, streamlined pipelines for importing captured in-the-wild data, and tools for exporting to video, point cloud and mesh representations. The modularity of Nerfstudio enables the development of Nerfacto, our method that combines components from recent papers to achieve a balance between speed and quality, while also remaining flexible to future modifications. To promote community-driven development, all associated code and data are made publicly available with open-source licensing at https://nerf.studio.
Ethan Weber

2:45 pm

Bevy: Taking the Entity-Component-System Architecture Seriously

Bevy: Taking the Entity-Component-System Architecture Seriously

Rust has been sold as the next big programming language for game development for a decade, but game studios have hesitated to embrace it. Does Bevy, an ECS-first Rust game engine with community momentum, change the calculation? As a maintainer of Bevy, I'll give you an earnest answer based on my experience working with and talking to commercial teams: who will it work for, who will be disappointed and what can you expect in the future of Bevy and Rust.
Alice Cecile

3:15 pm

Breakthrough Technologies of Cocos Engine for OpenHarmony, Next Generation Web and XR

Breakthrough Technologies of Cocos Engine for OpenHarmony, Next Generation Web and XR

Cocos Creator is the new generation of game development tool in Cocos family, it brings a complete set of 3D and 2D features while providing an intuitive, low cost and collaboration friendly workflow to game developers. It provides integral solutions for automotive, XR, Metaverse and Education. This talk will introduce the latest breakthrough technologies Cocos have achieved for OpenHarmony OS, next-generation Web graphics and XR.
Qingli Wang

3:45 pm

Afternoon Break

Afternoon Break

4:00 pm

Your Ticket To The Metaverse: Next-gen Platforms And Solutions To Revolutionize XR

Your Ticket To The Metaverse: Next-gen Platforms And Solutions To Revolutionize XR

In this talk, Bin Zhang will delve into the exciting frontier of mixed reality, where innovation is reshaping how we perceive and interact with the digital world. At the core of this transformation are four pivotal components: Snapdragon Spaces, OpenXR, an open ecosystem, and the Snapdragon Metaverse Fund. Qualcomm strives to build an accessible XR ecosystem, enabling developers to pioneer innovative experiences that will lead the next generation of immersive technology with Snapdragon Spaces, which is based on the Khronos OpenXR specification to enable application portability. Central to this paradigm shift is the concept of an open ecosystem where developers, creators, and innovators work together, leveraging shared resources and knowledge to push the boundaries of possibility.
Bin Zhang

4:30 pm

Graphics And Gaming : Open-source Vulkan Ecosystem On Arm

Graphics And Gaming : Open-source Vulkan Ecosystem On Arm

Vulkan is the well-designed open standard enabling advanced application features that fully unleash the potential of modern CPU and GPU architectures. Open-source software ecosystem is critical to the success of Vulkan on mobile. This talk will introduce Arm’s contribution to the development of Vulkan, from the one-stop solution for all Khronos Vulkan samples, to a broad range of open-source tools and game engines used by developers.
Nathan Li

5:00 pm

Panel discussion

Panel discussion

Secure your seat at the frontier of Tech.