IBM has introduced a new optical technology innovation that aims to change data centers and improve generative AI performance. IBM is bringing data transport within data centers closer to the speed of light by pioneering a new technology known as co-packaged optics. This invention replaces traditional electrical wire with optical connections, greatly increasing speed and energy efficiency.
From Fiber Optics To Data Centers.
Fiber optics have long been used to transmit data across large distances using light, resulting in excellent speed and dependability. However, most communication within data centers continues to be carried out via copper-based electrical connections. These connections link GPUs (the processors that enable AI), but they typically cause delays and inefficiencies since GPUs spend a lot of time waiting for data to arrive. IBM’s CPO invention incorporates the benefits of fiber optics into data centers, resulting in quicker and more efficient connectivity.
Advantages of Co-Packaged Optics
IBM’s study provides a prototype module that enables high-speed optical communications through the use of polymer optical waveguides (PWGs). This innovative technology gives a number of significant benefits:
Energy Efficiency: CPO technology uses five times less electricity than typical electrical wiring, helping to minimize energy expenses and environmental impact.
AI Training Speed: Generative AI models may be taught up to five times quicker. A large language model (LLM) that used to take three months to train may now be trained in three weeks.
Massive Energy Savings: The increased efficiency might save enough energy to power 5,000 US households for a year during the training of a single AI model.
Dario Gil, IBM’s Senior Vice President and Director of Research, noted that this discovery improves data center capacity to meet the rising demands of AI while decreasing energy usage. “Tomorrow’s chips will communicate using light, much like fiber optics cables do today, ushering in a new era of faster and more sustainable technology,” he told reporters.
Pushing the Limits of Speed and Capacity.
Modern processors now contain billions of transistors, but electrical connections have become a barrier for data transmission. IBM’s CPO invention enables an 80-fold boost in bandwidth compared to conventional electrical interconnects. The technique allows optical fibers to transmit terabits of data per second over distances ranging from millimeters to hundreds of meters, guaranteeing smooth connection between processors and servers.
Tested for Reliability
IBM’s CPO modules have undergone extensive testing for durability and performance, demonstrating their dependability in harsh situations such as high humidity, temperature changes, and mechanical stress. IBM has also accomplished high-density connectivity, with up to 128 optical channels on a single module, laying the groundwork for future expansion.
A Legacy of Innovation.
This research builds on IBM’s history of leadership in semiconductor technology. The firm has a history of innovation, including the development of 2-nanometer circuits and other cutting-edge technology. IBM conducted research and development in Albany, New York, and manufactured and tested at its site in Bromont, Quebec. These locations are part of the Northeast Semiconductor Corridor, which is critical to IBM’s innovation initiatives.
About IBM.
IBM is a global leader in artificial intelligence, cloud computing, and advanced technologies. The company’s ideas are designed to help organizations increase productivity, save costs, and remain competitive. For additional information, go to www.ibm.com.
Source: This information is based on IBM’s official press release from December 9, 2024. You can check out the full article here.
I’m Voss Xolani, and I’m deeply passionate about exploring AI software and tools. From cutting-edge machine learning platforms to powerful automation systems, I’m always on the lookout for the latest innovations that push the boundaries of what AI can do. I love experimenting with new AI tools, discovering how they can improve efficiency and open up new possibilities. With a keen eye for software that’s shaping the future, I’m excited to share with you the tools that are transforming industries and everyday life.