Engineering

The world's largest sand battery has been inaugurated in Finland. Developed by Polar Night Energy, this high-temperature thermal energy storage system stores heat in sand using low-cost, clean electricity. The project is a powerful example of how thermal storage can enhance grid flexibility, decarbonise heating, and accelerate the energy transition. - It can store up to 100 MWh of thermal energy. - It has a round-trip efficiency of 90%. - It offers a cost-effective alternative to lithium-ion batteries for long-term heat storage. - By replacing an old woodchip plant, the sand battery is expected to cut the local heating network's carbon emissions by 70%.

Arches are a cornerstone of architectural engineering due to their exceptional strength and efficiency. AI can significantly enhance the design and construction of arch structures. What do you think? Optimized Design: - AI algorithms can analyze loads, materials, and environmental conditions to design arches with optimal shape, size, and material use. - Generative design tools can explore thousands of variations to find the most efficient and aesthetically pleasing designs. Material Analysis: - AI can evaluate the performance of materials under compression and predict their long-term behavior. It helps engineers select sustainable and cost-effective materials. Structural Simulation: - AI-powered simulations can predict how arches will perform under various loads, stresses, and environmental conditions, reducing trial-and-error in the design phase. Construction Automation: - AI-guided robotics can precisely fabricate and assemble arch components, reducing human error and speeding up construction. - Drones and autonomous machines can assist in laying arch stones or blocks with high accuracy. Maintenance and Monitoring: - AI-driven sensors can monitor the health of arches in real-time, detecting cracks or structural weaknesses before they become critical. - Predictive maintenance systems powered by AI ensure the longevity of arch-based structures. Sustainability Goals: - AI helps reduce waste by optimizing material usage and construction methods. It can incorporate lifecycle assessments to ensure arches are designed with environmental impact in mind. #AI #Innovation via @jhconstruct #Technology

Exciting updates on Project GR00T! We discover a systematic way to scale up robot data, tackling the most painful pain point in robotics. The idea is simple: human collects demonstration on a real robot, and we multiply that data 1000x or more in simulation. Let’s break it down: 1. We use Apple Vision Pro (yes!!) to give the human operator first person control of the humanoid. Vision Pro parses human hand pose and retargets the motion to the robot hand, all in real time. From the human’s point of view, they are immersed in another body like the Avatar. Teleoperation is slow and time-consuming, but we can afford to collect a small amount of data.  2. We use RoboCasa, a generative simulation framework, to multiply the demonstration data by varying the visual appearance and layout of the environment. In Jensen’s keynote video below, the humanoid is now placing the cup in hundreds of kitchens with a huge diversity of textures, furniture, and object placement. We only have 1 physical kitchen at the GEAR Lab in NVIDIA HQ, but we can conjure up infinite ones in simulation. 3. Finally, we apply MimicGen, a technique to multiply the above data even more by varying the *motion* of the robot. MimicGen generates vast number of new action trajectories based on the original human data, and filters out failed ones (e.g. those that drop the cup) to form a much larger dataset. To sum up, given 1 human trajectory with Vision Pro  -> RoboCasa produces N (varying visuals)  -> MimicGen further augments to NxM (varying motions). This is the way to trade compute for expensive human data by GPU-accelerated simulation. A while ago, I mentioned that teleoperation is fundamentally not scalable, because we are always limited by 24 hrs/robot/day in the world of atoms. Our new GR00T synthetic data pipeline breaks this barrier in the world of bits. Scaling has been so much fun for LLMs, and it's finally our turn to have fun in robotics! We are creating tools to enable everyone in the ecosystem to scale up with us: - RoboCasa: our generative simulation framework (Yuke Zhu). It's fully open-source! Here you go: http://robocasa.ai - MimicGen: our generative action framework (Ajay Mandlekar). The code is open-source for robot arms, but we will have another version for humanoid and 5-finger hands: https://lnkd.in/gsRArQXy - We are building a state-of-the-art Apple Vision Pro -> humanoid robot "Avatar" stack. Xiaolong Wang group’s open-source libraries laid the foundation: https://lnkd.in/gUYye7yt - Watch Jensen's keynote yesterday. He cannot hide his excitement about Project GR00T and robot foundation models! https://lnkd.in/g3hZteCG Finally, GEAR lab is hiring! We want the best roboticists in the world to join us on this moon-landing mission to solve physical AGI: https://lnkd.in/gTancpNK

Should you try Google’s famous “20% time” experiment to encourage innovation? We tried this at Duolingo years ago. It didn’t work. It wasn’t enough time for people to start meaningful projects, and very few people took advantage of it because the framework was pretty vague. I knew there had to be other ways to drive innovation at the company. So, here are 3 other initiatives we’ve tried, what we’ve learned from each, and what we're going to try next. 💡 Innovation Awards: Annual recognition for those who move the needle with boundary-pushing projects. The upside: These awards make our commitment to innovation clear, and offer a well-deserved incentive to those who have done remarkable work. The downside: It’s given to individuals, but we want to incentivize team work. What’s more, it’s not necessarily a framework for coming up with the next big thing. 💻 Hackathon: This is a good framework, and lots of companies do it. Everyone (not just engineers) can take two days to collaborate on and present anything that excites them, as long as it advances our mission or addresses a key business need. The upside: Some of our biggest features grew out of hackathon projects, from the Duolingo English Test (born at our first hackathon in 2013) to our avatar builder. The downside: Other than the time/resource constraint, projects rarely align with our current priorities. The ones that take off hit the elusive combo of right time + a problem that no other team could tackle. 💥 Special Projects: Knowing that ideal equation, we started a new program for fostering innovation, playfully dubbed DARPA (Duolingo Advanced Research Project Agency). The idea: anyone can pitch an idea at any time. If they get consensus on it and if it’s not in the purview of another team, a cross-functional group is formed to bring the project to fruition. The most creative work tends to happen when a problem is not in the clear purview of a particular team; this program creates a path for bringing these kinds of interdisciplinary ideas to life. Our Duo and Lily mascot suits (featured often on our social accounts) came from this, as did our Duo plushie and the merch store. (And if this photo doesn't show why we needed to innovate for new suits, I don't know what will!) The biggest challenge: figuring out how to transition ownership of a successful project after the strike team’s work is done. 👀 What’s next? We’re working on a program that proactively identifies big picture, unassigned problems that we haven’t figured out yet and then incentivizes people to create proposals for solving them. How that will work is still to be determined, but we know there is a lot of fertile ground for it to take root. How does your company create an environment of creativity that encourages true innovation? I'm interested to hear what's worked for you, so please feel free to share in the comments! #duolingo #innovation #hackathon #creativity #bigideas

Last week, I described four design patterns for AI agentic workflows that I believe will drive significant progress: Reflection, Tool use, Planning and Multi-agent collaboration. Instead of having an LLM generate its final output directly, an agentic workflow prompts the LLM multiple times, giving it opportunities to build step by step to higher-quality output. Here, I'd like to discuss Reflection. It's relatively quick to implement, and I've seen it lead to surprising performance gains. You may have had the experience of prompting ChatGPT/Claude/Gemini, receiving unsatisfactory output, delivering critical feedback to help the LLM improve its response, and then getting a better response. What if you automate the step of delivering critical feedback, so the model automatically criticizes its own output and improves its response? This is the crux of Reflection. Take the task of asking an LLM to write code. We can prompt it to generate the desired code directly to carry out some task X. Then, we can prompt it to reflect on its own output, perhaps as follows: Here’s code intended for task X: [previously generated code] Check the code carefully for correctness, style, and efficiency, and give constructive criticism for how to improve it. Sometimes this causes the LLM to spot problems and come up with constructive suggestions. Next, we can prompt the LLM with context including (i) the previously generated code and (ii) the constructive feedback, and ask it to use the feedback to rewrite the code. This can lead to a better response. Repeating the criticism/rewrite process might yield further improvements. This self-reflection process allows the LLM to spot gaps and improve its output on a variety of tasks including producing code, writing text, and answering questions. And we can go beyond self-reflection by giving the LLM tools that help evaluate its output; for example, running its code through a few unit tests to check whether it generates correct results on test cases or searching the web to double-check text output. Then it can reflect on any errors it found and come up with ideas for improvement. Further, we can implement Reflection using a multi-agent framework. I've found it convenient to create two agents, one prompted to generate good outputs and the other prompted to give constructive criticism of the first agent's output. The resulting discussion between the two agents leads to improved responses. Reflection is a relatively basic type of agentic workflow, but I've been delighted by how much it improved my applications’ results. If you’re interested in learning more about reflection, I recommend: - Self-Refine: Iterative Refinement with Self-Feedback, by Madaan et al. (2023) - Reflexion: Language Agents with Verbal Reinforcement Learning, by Shinn et al. (2023) - CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing, by Gou et al. (2024) [Original text: https://lnkd.in/g4bTuWtU ]

#Diversity in high-tech fields remains critically low. The Equal Employment Opportunity Commission (EEOC) recently reported that #Black and #Latino professionals are underrepresented in high-tech roles, especially in leadership. These numbers highlight ongoing structural barriers in hiring, promotion and retention. This gap is a missed opportunity to tap into a wealth of diverse talent and perspectives essential to the future of tech. However, addressing and thoroughly fixing these challenges will require time, consistent effort and a long-term commitment to systemic change. Companies can support the progression of representation in tech by investing in training, mentorship and internship opportunities that open doors for people who were historically shut out. Programs like internXL, a platform that is committed to increasing diversity and inclusion in the internship hiring process for top companies, are making a significant impact. Similarly, the expansion of STEM education at institutions like Cornell University is helping to connect talented young people from underrepresented communities with opportunities for high-tech careers. When we work together to remove these barriers, we’re fostering a more inclusive workforce and strengthening innovation, problem-solving and leadership in the industry. Let’s build a tech future that reflects the diversity of our society. https://bit.ly/3UNtOCh

Something VERY cool just happened in California and… it could be the future of energy.   On July 29, just as the sun was setting, California’s electric grid was reaching peak demand.   However, instead of ramping up fossil fuel resources, the California Independent System Operator (CAISO) and local utilities decided to lean on a network of thousands of home batteries.   More than 100,000 residential battery systems (made up primarily by Sunrun and Tesla customers) delivered about 535 megawatts of power to California’s grid right as demand peaked, visibly reducing net load (as shown in the graphic).   Now, this may not seem like a lot but 535 megawatts is enough to power more than half of the city of San Francisco and that can make all the difference when a grid is under stress.   This is what’s called a Virtual Power Plant or VPP. It’s a network of distributed energy resources that grid operators can call on in an emergency to provide greater resilience to our energy systems. Homeowners are compensated for the dispatch, grid operators are given another tool for reliability, and ratepayers are saved from instability. It’s a win-win-win.   Now, this was just a test to prepare for other need-based dispatches during heat waves in August and September. But it’ historic.   As homeowners add more solar and storage resources, the impact of these dispatch events will become even more profound and even more necessary. This was the second time this summer that VPPs have been dispatched in California and I expect to see even more as this technology improves.   Shout out to Sunrun, Tesla, and all companies who participated. Keep up the great work.

Powering Cities with Every Step: Japan’s Smart Energy Innovation ⚡🚶♂️ What if your daily walk could help power your city? In Japan, it already does. Train stations, sidewalks, and bridges are being fitted with piezoelectric sensors—materials that generate electricity from movement. 🔹 How It Works – Every footstep applies pressure, creating a tiny electric charge. Multiply that by thousands of daily commuters, and it’s enough to power LED screens, lights, and signage. 🔹 Real-World Impact – Tokyo train stations track how much energy passengers generate, turning commutes into a live science experiment. Bridges capture vibrations from cars to power streetlights. 🔹 The Big Picture – While this won’t replace traditional energy sources, it’s a step toward greener, self-sustaining infrastructure. 💡 Could this technology be scaled for more cities? Where else could we harvest untapped energy? Let’s discuss! 👇 #Innovation #SustainableEnergy #SmartCities #GreenTech #FutureInfrastructure