李飞飞:World Labs 加入 AMD,寻找一个更新的世界
寻找一个更新的世界
World Labs 即将加入 @AMD。这对 @theworldlabs、我们的团队以及我个人而言,都是一个重大时刻。我想借此分享这意味着什么,以及为什么我对即将开启的新篇章如此兴奋。
“来吧,我的朋友们,寻找一个更新的世界,仍为时未晚。” ——丁尼生,《尤利西斯》
一段成长的故事
对我而言,AI 既关乎个人,也关乎人类文明。
2000 年,我刚成为一名研究生,就进入了这个领域。我怀着好奇心,想探索机器与大脑的视觉智能问题。当时我并不知道,这是我职业生涯的起点,而令我惊讶的是,这段职业生涯一直处于 AI 走向成熟的核心地带。我实验室早期名为 ImageNet 的工作,与神经网络算法及其在 GPU 上的实现一道,帮助开启了现代 AI 的时代。此后,我的整个职业生涯都致力于推动 AI 从主要属于学术探索的课题,发展为我们这个时代最具创新性和变革性的技术。
在这段历程中,从计算机视觉、深度学习、机器人和医疗健康研究,到以首席科学家的身份创立 Google Cloud 的 AI 部门,再到担任斯坦福以人为本人工智能研究院的创始院长,我的工作始终受到同一个愿望的引导:解决现实世界的问题,与人类携手,让社会变得更好。当生成式 AI 开始带来变革、大规模前沿 AI 研究从学术界转向产业界时,我意识到,最有可能产生深远而广泛积极影响的道路,就是创办一家初创公司,去挑战最有雄心的技术难题。
2024 年初,我与出色的联合创始人 Ben Mildenhall 和 Justin Johnson 一起创办了 World Labs。他们都是世界一流的 AI 研究者,各自以重要的方式推动了这个领域。我们的目标是建立一家前沿研究实验室,专注于 AI 中一些最重要的挑战;一旦解决这些挑战,AI 处理现实问题的能力就会得到显著提升。
世界并非只由文字构成
我们建立这家公司,源于一个根本信念:仅靠语言不足以发展模型。宇宙不是由文字组成的,而是由真实事物构成的。从科学、娱乐到机器人,许多最值得 AI 解决的问题,都要求模型能够对物理世界的结构与行为进行推理。攻克这一类问题,需要一支独特的团队,具备数据、计算机视觉、大模型训练、系统乃至计算机图形学等广泛技能。我非常幸运,组建了一支由研究者与工程师组成的创始团队,其中汇集了这些领域的世界级专家。我们一起着手训练全新类别的基础模型,挑战空间智能中最困难的问题,并朝着目标取得了显著进展。
自 2024 年创立以来,World Labs 已经建立起领先的 AI 空间智能能力,覆盖从创意工作到设计等多种用途。我们组建了世界领先的图像、视频与空间重建模型训练团队。通过收购 SceniX,我们也正在打造行业领先的机器人仿真能力。
最近,我们发布了 Atlas,这是一种首创的全模态模型架构,解决了空间智能中一个关键的未解问题:预测新的摄像机视角。就像大语言模型能够根据一段文字预测下一个 token,从零开始训练的 Atlas 也能根据输入的二维图像预测下一个视角,其表现甚至超过了专用模型所取得的最先进结果。它将生成式模型与多视图几何相结合,实质上解决了计算机视觉中长期存在的稀疏重建问题。这将对设计、工程、科学与机器人等领域产生直接而深远的影响。
我们看到,许多领域都对 Atlas 表现出了极大兴趣:机器人强化学习环境、用于治疗和娱乐的场景生成,以及面向房地产、设计和建筑的真实世界重建。未来还会有更多用途。
循着我们的北极星,走向 AMD
World Labs 在如此短的时间内取得的研究与技术突破,进一步激发了我们的雄心,也让我们清晰地看到了 AI 解决空间与物理世界问题的潜力。如今,我们已经有了切实的证据,证明这些可能性。我们希望尽一切努力,加速这个未来的到来。
要做到这一点,就需要扩大我们的投入,拓展我们的触达范围,并更加贴近硬件。如果没有专注于硬件的投入,AI 的效率就会受限,规模也会受限。而就我们的目标而言,它也将继续被困在数字世界里。
这就说到了 AMD。从公司创立之初,我们就与 AMD 开展了合作。AMD 首席执行官苏姿丰博士是我们的早期投资者,也一直相信我们的使命。我们共同相信,AI 能推动社会走向更好的未来。在各自的科技事业旅程中,她也是我非常好的朋友。
去年,我们开始了深入的技术合作,首先在 AMD GPU 上进行模型训练与推理优化。我们近距离见证了苏姿丰如何以大胆的领导力和惊人的发展势头,让 AMD 成为硬件生态中的重要参与者。随着双方团队一起工作,我们意识到,将我们的 AI 生态中的软件与硬件、基础模型与应用整合起来,是多么自然的契合。
就像当初我清楚地知道,是时候创办一家初创公司,启动超越大语言模型的基础模型研发,并在 AI 领域实现最大的影响力一样,如今我也再次清楚地看到:对我和 World Labs 而言,正确的道路就是成为 AMD 的一部分,继续我们的使命。我们共同致力于持续推进 AI 前沿,解决真实问题,并与社区及整个生态系统以开放的方式开展这项工作。我们的使命坚定不移;对于继续建设一家世界领先、能够长期延续数十年的前沿研究机构,我们更加充满期待。我们也承诺提供最好的开放模型和平台,让 AI 从硬件、软件、模型,到支撑这一切的数据平台,都能端到端地运行。
解决现实问题,造福人类
能够踏上这段共同的旅程,走向我们希望一起建设的未来,我们感到无比振奋。在那个未来中,强大的 AI 平台与系统将被开发和部署,用来帮助解决人类面临的最根本问题:从药物发现到释放人类创造力,从改变学习方式到开启下一代机器人技术。
我将以执行副总裁兼首席科学家的身份加入,直接与苏姿丰及其团队合作,这让我无比兴奋。我的职业生涯将我带到了这一刻:作为一名科学家和技术领导者,在一家领先的 AI 公司中,继续壮大并领导一支前沿研究团队。面对这个更广阔的平台和机会,我深感谦逊、感激,也满怀希望,相信我们能够建设自己所信仰的未来。指引我们的,仍是那颗始终激励我打造服务于人类的技术的北极星。我对未来充满期待,也非常感激 World Labs 与 AMD 有机会携手创造这个未来。
对照原文
To Seek a Newer World World Labs is joining @AMD. This is a huge moment for @theworldlabs, our team, and for me, and I wanted to take a moment to share what this means and why I’m so excited for this next chapter. “Come, my friends, ‘Tis not too late to seek a newer world.” – Lord Tennyson, Ulysses A coming of age story AI to me is both personal and civilizational. I entered the field as a fresh graduate student in the year 2000, chasing my curiosity for solving the problem of visual intelligence for machines and the brain. I didn’t know it then, but these were the first steps of a career that’s been (to my amazement) at the center of AI’s coming of age. The early work from my lab called ImageNet helped usher in the age of modern AI, along with neural network algorithms and their implementation on GPUs. Since then, I’ve spent my entire career pushing AI from largely an academic curiosity to become the most innovative and transformative technology of our era. Throughout this time, from my research in computer vision, deep learning, robotics and healthcare, to founding Google Cloud’s AI unit as a chief scientist, to becoming the founding director of Stanford’s Human-Centered AI institute, my work has always been guided by the desire to solve real world problems, hand in hand with humans for societal betterment. When generative AI began its transformation, and frontier AI research at scale moved from academia to industry, I knew the path with the deepest and broadest potential for positive impact would be creating a startup to tackle the most audacious technical problems. Together with my incredible co-founders Ben Mildenhall and Justin Johnson, two world class AI researchers who have each moved the field in significant ways, I founded World Labs at the beginning of 2024. Our goal was to build a frontier lab focusing on some of the most important challenges in AI, which if solved, would dramatically improve AI’s ability to tackle real world problems. The world is not just made up of words We built the company guided by the foundational belief that language alone isn't sufficient for model development. The universe isn’t made up of words, it’s made of real things. So many of the most important problems for AI to solve, from science to entertainment to robotics, require models to reason over the structure and behavior of the physical world. Tackling this problem domain requires a unique team with wide ranging skills including data, computer vision, large model training, systems and even computer graphics. I feel very lucky to have built a founding team of researchers and engineers that contains world experts across these areas. Together, we set out to train new classes of foundation models to tackle the hardest problems in spatial intelligence, and we’ve made significant strides toward our goals. Since our founding in 2024, World Labs has built leading AI spatial intelligence capabilities for everything from creative work to design. We built the world leading model training team for images, video and spatial reconstruction. And, with the acquisition of SceniX, we’re building towards an industry leading capability for robotics simulation. Recently we released Atlas, a first of its kind omni model architecture that solves a key outstanding problem in spatial intelligence: new camera view prediction. Like LLMs can predict the next token from a line of text, Atlas, trained from scratch, can predict the next view from an input of 2D images, outperforming state of the art results even by specialized models. It has essentially solved a long standing problem in computer vision called sparse reconstruction, by combining generative models with multiview geometry. This has direct and far reaching consequences: from design and engineering to science and robotics. We’ve seen incredible interest in Atlas across many domains: RL environments for robotics; scene generation for therapy and entertainment; and real world reconstruction for real estate, design and construction, and so much more to come. Following our North Star to AMD The research and technical breakthroughs we achieved at World Labs in such a short amount of time have only fueled our ambition and given us a clear vision for the potential for AI to solve spatial and physical world problems. Now that we have tangible proof of the possibilities, we want to do everything we can to accelerate the future. To do this requires scaling our efforts, widening our reach, and getting closer to the hardware. Without having a focused hardware effort, AI is hobbled in efficiency. And scale. And for our purposes, remains trapped in the digital world. Which brings me to AMD. We’ve partnered with AMD since our earliest days. AMD’s CEO, Dr. Lisa Su was an early investor and believer in our mission, and we shared a belief that AI could propel society toward a better future. She has also been a great friend to me as we each journey through the world of technology. We began a deep technical partnership last year starting with model training and inference optimization on AMD GPUs. We’ve seen up close how Lisa is boldly leading AMD as a major player in the hardware ecosystem with incredible momentum. As our teams worked together, we realized what a natural fit it would be to bring together our AI ecosystem of software and hardware, foundation models and applications. Just like I knew it was time to do a startup to jumpstart the work of creating foundation models beyond LLMs and achieve the most impact in AI, it’s again very clear that the right path for myself and World Labs is to continue our mission as a part of AMD. Together we’re committed to keep pushing the frontier of AI to solve real problems, and doing so openly with the community and the entire ecosystem. We’re unwavering in our mission, and even more excited to continue building a world leading frontier research organization that is durable for the decades ahead. And we are committed to providing the best open models and platforms for running AI end to end from hardware to software to models to the data platforms needed to fuel it all. Solving real problems, for human betterment We’re extremely thrilled to be part of a shared journey towards the future we want to build together; where powerful AI platforms and systems are developed and deployed to help solve the most fundamental problems that humanity faces: from drug discovery, to unleashing human creativity; from transforming learning to unlocking the next generation of robotics. And I can’t be more excited to join as an Executive Vice President and Chief Scientist, working directly with Lisa and her team. My career has led up to this moment - to continue growing and running a frontier research team, within a leading AI company, as a scientist and a technology leader. With this expanded platform and opportunity, I feel a deep sense of humility, gratitude and hopefulness that we will build a future we believe in, guided by the same North Star that has always inspired me to build technology in service of humanity. I am beyond excited for the future and grateful for the opportunity for World Labs and AMD to build it together. https://drfeifei.substack.com/worldlabs-joining-amd