https://robertkovax.com dr robert kovacs Wed, 21 Oct 2020 16:59:27 +0000 https://robertkovax.com en https://robertkovax.com/robert-kovacs Wed, 18 Jun 2014 08:30:19 +0000 dr robert kovacs https://robertkovax.com/robert-kovacs <img width="399" height="399" width_o="399" height_o="399" data-src="https://freight.cargo.site/t/original/i/023f6a5636f8f139a73979e40e13c52b94af466e9c709aa9c4a4738998972153/robert_kovacs_round_bw.png" data-mid="195624709" border="0" data-scale="29" src="https://freight.cargo.site/w/399/i/023f6a5636f8f139a73979e40e13c52b94af466e9c709aa9c4a4738998972153/robert_kovacs_round_bw.png" />dr.-ing. robert kovacs Postdoctoral Researcher @ Freie Universität Berlin Mechatronics | Robotics | HCI | Fabrication (ex Hasso Plattner Institute, Microsoft Research, Interactive-Scape) contactmail [at] robertkovacs.de scholar | acm dl | linkedin | orcid | github https://robertkovax.com/featured-projects Wed, 05 Dec 2018 18:07:11 +0000 dr robert kovacs https://robertkovax.com/featured-projects phd thesis: human-scale personal fabrication(4 full papers) advised by prof. Patrick Baudisch at the Hasso Plattner Institute - Human Computer Interaction lab. PDF (DOI:https://doi.org/10.25932/publishup-55539) <img width="600" height="338" width_o="600" height_o="338" data-src="https://freight.cargo.site/t/original/i/269f5edaa283ca54d41e21c94663d128db279ee60d3325423997501ba2272322/30s_preview_optimized.gif" data-mid="118246514" border="0" src="https://freight.cargo.site/w/600/i/269f5edaa283ca54d41e21c94663d128db279ee60d3325423997501ba2272322/30s_preview_optimized.gif" /> Trusscillator: a System for Fabricating Human-Scale Human-Powered Oscillating Devices ACM UIST’21 Robert Kovacs, Lukas Rambold, Lukas Fritzsche, Dominik Meier, Jotaro Shigeyama, Shohei Katakura, Ran Zhang, Patrick Baudisch Trusscillator is an end-to-end system that allows non-engineers to create human-scale human-powered devices that perform oscillatory movements, such as playground equipment, workout devices, and interactive kinetic installations. Best Demo Honorable Mention Award <img width="40" height="46" width_o="40" height_o="46" data-src="https://freight.cargo.site/t/original/i/e2aa54185043e15c73ea032625b1cd8da379d781dfdc9be6dad4cae98e3703b0/trophy.png" data-mid="118250003" border="0" data-scale="100" src="https://freight.cargo.site/w/40/i/e2aa54185043e15c73ea032625b1cd8da379d781dfdc9be6dad4cae98e3703b0/trophy.png" /> ACM publication page TrussFormer: 3D Printing Large Kinetic Structures ACM UIST’18 Robert Kovacs, Alexandra Ion, Pedro Lopes, Tim Oesterreich, Johannes Filter, Philip Otto, Tobias Arndt, Nico Ring, Melvin Witte, Anton Synytsia, and Patrick Baudisch TrussFormer is an integrated end-to-end system that allows users to 3D print large-scale kinetic structures, i.e., structures that involve motion and and are subject to inertial forces. CHI’19 Best Visual Communication Award <img width="40" height="46" width_o="40" height_o="46" data-src="https://freight.cargo.site/t/original/i/e2aa54185043e15c73ea032625b1cd8da379d781dfdc9be6dad4cae98e3703b0/trophy.png" data-mid="118250003" border="0" data-scale="100" src="https://freight.cargo.site/w/40/i/e2aa54185043e15c73ea032625b1cd8da379d781dfdc9be6dad4cae98e3703b0/trophy.png" /> ACM publication page <img width="1131" height="806" width_o="1131" height_o="806" data-src="https://freight.cargo.site/t/original/i/0eae54cd533e34e993e65765818d80c2dc0a4ab49412e4a557497b3c916f54b3/IMG_0331rp_res_crop.jpg" data-mid="71732005" border="0" src="https://freight.cargo.site/w/1000/i/0eae54cd533e34e993e65765818d80c2dc0a4ab49412e4a557497b3c916f54b3/IMG_0331rp_res_crop.jpg" /> TrussFab: Fabricating Sturdy Large-Scale Structures on Desktop 3D Printers ACM CHI’17Robert Kovacs, Anna Seufert, Ludwig Wall, Hsiang-Ting Chen, Florian Meinel, Willi Müller, Si-jing You, Maximilian Brehm, Jonathan Striebel, Yannis Kommana, Alexander Popiak, Thomas Bläsius, and Patrick Baudisch TrussFab is an integrated end-to-end system that allows users to fabricate large scale structures that are sturdy enough to carry human weight. TrussFab achieves the large scale by complementing 3D print with plastic bottles. ACM publication page Protopiper: Physically Sketching Room-Sized Objects at Actual Scale ACM UIST ‘15&nbsp; Harshit Agrawal, Udayan Umapathi, Robert Kovacs, Johannes Frohnhofen, Hsiang-Ting Chen, Stefanie Mueller, Patrick Baudisch Protopiper is a computer aided, hand-held fabrication device that allows users to sketch room-sized objects at actual scale. The key idea behind protopiper is that it forms adhesive tape into tubes as its main building material, rather than extruded plastic or photopolymer line. UIST Best Demo Award <img width="40" height="46" width_o="40" height_o="46" data-src="https://freight.cargo.site/t/original/i/e2aa54185043e15c73ea032625b1cd8da379d781dfdc9be6dad4cae98e3703b0/trophy.png" data-mid="118250003" border="0" src="https://freight.cargo.site/w/40/i/e2aa54185043e15c73ea032625b1cd8da379d781dfdc9be6dad4cae98e3703b0/trophy.png" /> ACM publication page internship @Microsoft_Research <img width="480" height="270" width_o="480" height_o="270" data-src="https://freight.cargo.site/t/original/i/e6942b98e780df00774c03d15f9b50308b33ee8f2b0de3ac277a3903ab7e5594/Pivot-GIF.gif" data-mid="117763572" border="0" src="https://freight.cargo.site/w/480/i/e6942b98e780df00774c03d15f9b50308b33ee8f2b0de3ac277a3903ab7e5594/Pivot-GIF.gif" /> Haptic PIVOT: On-Demand Handhelds in VR ACM UIST’20 Robert Kovacs, Eyal Ofek, Mar Gonzalez Franco, Alexa Fay Siu, Sebastian Marwecki, Christian Holz, Mike Sinclair PIVOT is a wrist-worn haptic device that renders virtual objects into the user’s hand on demand. Its simple design comprises a single actuated joint that pivots a haptic handle into and out of the user’s hand, rendering the haptic sensations of grasping, catching, or throwing an object – anywhere in space. ACM publication page US Patent US11003247B1 <img width="1004" height="652" width_o="1004" height_o="652" data-src="https://freight.cargo.site/t/original/i/ea76af654dc0754aedcbd5f92aefcf6651466099ed2b284ddac98bdef156da3c/cane1.png" data-mid="69577467" border="0" src="https://freight.cargo.site/w/1000/i/ea76af654dc0754aedcbd5f92aefcf6651466099ed2b284ddac98bdef156da3c/cane1.png" /> Virtual Reality Without Vision: A Haptic and Auditory White Cane to Navigate Complex Virtual Worlds ACM CHI‘20 (best paper honorable mention) <img width="40" height="46" width_o="40" height_o="46" data-src="https://freight.cargo.site/t/original/i/e2aa54185043e15c73ea032625b1cd8da379d781dfdc9be6dad4cae98e3703b0/trophy.png" data-mid="118250003" border="0" src="https://freight.cargo.site/w/40/i/e2aa54185043e15c73ea032625b1cd8da379d781dfdc9be6dad4cae98e3703b0/trophy.png" /> Alexa F. Siu, Mike Sinclair, Robert Kovacs, Eyal Ofek, Christian Holz, Ed Cutrell How might virtual reality (VR) aid a blind person in familiarization with an unexplored space? Exploring the design of immersive VR experiences accessible to blind people with the goal of facilitating orientation and mobility training. ACM publication page R&amp;D collaborative robotics <img width="3538" height="2624" width_o="3538" height_o="2624" data-src="https://freight.cargo.site/t/original/i/c7786d8a9cfbae9ec53712f3f752c1991f01cc06862eeaaab41f9807d534da32/lerosh_mirka2_crop.jpg" data-mid="195626355" border="0" src="https://freight.cargo.site/w/1000/i/c7786d8a9cfbae9ec53712f3f752c1991f01cc06862eeaaab41f9807d534da32/lerosh_mirka2_crop.jpg" /> LEROSH: training robots for crafts(at interactive-scape &amp; werk5) The Lerosh project is about exploring how machine learning can help artisans to work with collaborative robots on unique artifacts. In particular, training robots with the "master's movements" that can be later generalized to any object, geometry, or material. The key challenge here is to extract the high-level skills from the craftsman's demonstration and to replicate the fine-motoric movements using multi-sensory feedback loops. project page: LEROSH.de latest publication at UIST <img width="603" height="531" width_o="603" height_o="531" data-src="https://freight.cargo.site/t/original/i/df0fb848fdddb2aa9b16b2545f0a34f78e300aa99c80a8e5c1cc85ef85ad6d4c/airtied_device_youtube.jpg" data-mid="195446498" border="0" src="https://freight.cargo.site/w/603/i/df0fb848fdddb2aa9b16b2545f0a34f78e300aa99c80a8e5c1cc85ef85ad6d4c/airtied_device_youtube.jpg" /> AirTied: Automatic Personal Fabrication of Truss Structures ACM UIST’23 Lukas Rambold, Robert Kovacs, Conrad Lempert, Muhammad Abdullah, Helena Lendowski, Lukas Fritzsche, Martin Taraz, and Patrick Baudisch AirTied is a device that fabricates truss structures in a fully automatic fashion. AirTied achieves this by unrolling a 20cm-wide inflatable plastic tube and tying nodes into it. AirTied creates nodes by holding onto a segment of tube, stacking additional tube segments on top of it, tying them up, and releasing the result. The resulting structures are material-efficient and light as well as sturdy, as we demonstrate by creating a 6m-tower. Unlike the prior art, AirTied requires no scaffolding and no building blocks, bringing automated truss construction into the reach of personal fabrication. ACM publication page metamaterial mechanisms <img width="1233" height="542" width_o="1233" height_o="542" data-src="https://freight.cargo.site/t/original/i/fc2d823261e8c704995b04b7cbc42621d2ad4b61e2e8ba2f688d30bd1e67f75a/texture.png" data-mid="30630338" border="0" src="https://freight.cargo.site/w/1000/i/fc2d823261e8c704995b04b7cbc42621d2ad4b61e2e8ba2f688d30bd1e67f75a/texture.png" /> Metamaterial TexturesACM CHI‘18Alexandra Ion, Robert Kovacs, Oliver S. Schneider, Pedro Lopes, and Patrick Baudisch Metamaterial textures are 3D printed surface geometries that can perform a controlled transition between two or more textures. Metamaterial textures are integrated into 3D printed objects and allow designing how the object interacts with the environment and the user’s tactile sense. ACM publication page <img width="666" height="440" width_o="666" height_o="440" data-src="https://freight.cargo.site/t/original/i/1eda626b0b45e82312e2e9bc5802353f532e7f6781a28971eec2410660ceaa12/digital.JPG" data-mid="30631210" border="0" src="https://freight.cargo.site/w/666/i/1eda626b0b45e82312e2e9bc5802353f532e7f6781a28971eec2410660ceaa12/digital.JPG" /> Digital Mechanical MetamaterialsACM CHI‘17 Alexandra Ion, Ludwig Wall, Robert Kovacs, and Patrick Baudisch In this paper, we explore how to embody mechanical computation into 3D printed objects, i.e., without electronic sensors, actuators, or controllers typically used for this purpose. ACM publication page <img width="1901" height="968" width_o="1901" height_o="968" data-src="https://freight.cargo.site/t/original/i/a56b2e64d88d0b23ea441374f3f1f4518ef9c094e72906cc8ac6dcfd95e95595/mechanism.jpg" data-mid="30629407" border="0" src="https://freight.cargo.site/w/1000/i/a56b2e64d88d0b23ea441374f3f1f4518ef9c094e72906cc8ac6dcfd95e95595/mechanism.jpg" /> Metamaterial MechanismsACM UIST ‘16 (best paper honorable mention)<img width="40" height="46" width_o="40" height_o="46" data-src="https://freight.cargo.site/t/original/i/e2aa54185043e15c73ea032625b1cd8da379d781dfdc9be6dad4cae98e3703b0/trophy.png" data-mid="118250003" border="0" src="https://freight.cargo.site/w/40/i/e2aa54185043e15c73ea032625b1cd8da379d781dfdc9be6dad4cae98e3703b0/trophy.png" /> Alexandra Ion, Johannes Frohnhofen, Ludwig Wall, Robert Kovacs, Mirela Alistar, &nbsp;Jack Lindsay, Pedro Lopes, Hsiang-Ting Chen, and Patrick Baudisch So far, metamaterials were understood as materials—we want to think of them as machines. We demonstrate metamaterial objects that perform a mechanical function. ACM publication page laser-cutting and fabrication&nbsp; <img width="1383" height="870" width_o="1383" height_o="870" data-src="https://freight.cargo.site/t/original/i/bcace5031104dfcd3073331683e2736aa317f960033a88daf1854fb4f089f93c/kerfmeter1.png" data-mid="177384781" border="0" src="https://freight.cargo.site/w/1000/i/bcace5031104dfcd3073331683e2736aa317f960033a88daf1854fb4f089f93c/kerfmeter1.png" /> Kerfmeter: Automatic Kerf Calibration for Laser Cuting ACM CHI‘23 Shohei Katakura, Martin Taraz, Muhammad Abdullah, Paul Methfessel, Lukas Rambold, Robert Kovacs, and Patrick Baudisch Kerfmeter is a hardware + software device that automatically determines how much material the laser cutter burns off, also known as kerf. Its knowledge about kerf allows Kerfmeter to make the joints of laser cut 3D models fit together with just the right tension, i.e., loose enough to allow for comfortable assembly, yet tight enough to hold parts together without glue—all this without user interaction. ACM publication page <img width="1371" height="1079" width_o="1371" height_o="1079" data-src="https://freight.cargo.site/t/original/i/8b44be6558eda2a5a9ddfa5a577d0fd659235617016e15f4680c9fa2c6cd87f3/youtube_thumb.png" data-mid="117696833" border="0" src="https://freight.cargo.site/w/1000/i/8b44be6558eda2a5a9ddfa5a577d0fd659235617016e15f4680c9fa2c6cd87f3/youtube_thumb.png" /> Fastforce: Real-Time Reinforcement of Laser-Cut Structures ACM CHI‘20 Muhammad Abdullah, Martin Taraz, Yannis Kommana, Shohei Katakura, Robert Kovacs, Jotaro Shigeyama,&nbsp; Thijs Roumen, and Patrick Baudisch fastForce is a software tool that detects structural flaws in laser cut 3D models and fixes them by introducing additional plates into the model. It fixes structural issues in real-time, while users stay focused on editing their models and without ever becoming aware of any structural issues. ACM publication page <img width="1210" height="721" width_o="1210" height_o="721" data-src="https://freight.cargo.site/t/original/i/b9dc9b83a9f5bb39725a37f500d4c8c09f8ff424677255f4cbf518d02c00c90d/kyub.JPG" data-mid="36575627" border="0" src="https://freight.cargo.site/w/1000/i/b9dc9b83a9f5bb39725a37f500d4c8c09f8ff424677255f4cbf518d02c00c90d/kyub.JPG" /> Kyub: a 3D Editor for Modeling Laser-Cut Objects ACM CHI‘19 Patrick Baudisch , Arthur Silber, Yannis Kommana, Milan Gruner, Ludwig Wall, Kevin Reuss, Lukas Heilman, Robert Kovacs, Daniel Rechlitz, and Thijs Roumen Kyub is an interactive editing system for laser cutting. Unlike earlier systems, kyub affords constructing closed box structures by stacking cubic shaped primitives&nbsp;–boxels. This interaction provides the strong affordance and ease of use of a voxel-based editor, while building with boxels ensures the structural stability. ACM publication page <img width="1496" height="1194" width_o="1496" height_o="1194" data-src="https://freight.cargo.site/t/original/i/29ca9d45f426f4b76df4a2e7ae5836ab2cfb5e42461acaa428c755730c99900b/IMG_0200.jpg" data-mid="30629304" border="0" src="https://freight.cargo.site/w/1000/i/29ca9d45f426f4b76df4a2e7ae5836ab2cfb5e42461acaa428c755730c99900b/IMG_0200.jpg" /> FormFab: Continuous Interactive Fabrication ACM TEI‘19 Stefanie Mueller, Anna Seufert, Huaishu Peng, Robert Kovacs, Kevin Reuss, François Guimbretière, Patrick Baudisch FormFab is an interactive fabrication system that can change a workpiece’s shape continuously while the user is interacting. This enables users to explore different sizes of a shape with a single interaction rather than in multiple turns. We accomplish this using a process called formative fabrication, which rather than adding or subtracting, reshapes the existing material. In our system, users interactively control a pneumatic air pump that applies either pressure or vacuum to a compliant thermoplastic sheet, thereby pushing the material outwards or pulling it inwards. ACM publication page <img width="1284" height="963" width_o="1284" height_o="963" data-src="https://freight.cargo.site/t/original/i/cfd90eb1c25d2d69bf16af501d20e344e970ec79d4ce48d4720d0118a7def16a/patching.PNG" data-mid="30628827" border="0" src="https://freight.cargo.site/w/1000/i/cfd90eb1c25d2d69bf16af501d20e344e970ec79d4ce48d4720d0118a7def16a/patching.PNG" /> Patching Physical Objects ACM UIST ‘15 Alexander Teibrich, Stefanie Mueller, François Guimbretière, Robert Kovacs, Stefan Neubert, and&nbsp;Patrick Baudisch Personal fabrication is currently a one-way process: once an object has been fabricated with a 3D printer, it cannot be changed anymore. In this paper, we propose a different approach: instead of re-printing the entire object from scratch, we suggest patching the existing object to reflect the next design iteration. ACM publication page haptic interfaces for blind users <img width="2966" height="1620" width_o="2966" height_o="1620" data-src="https://freight.cargo.site/t/original/i/b3c5be098f5729bfba61b4e188a77efdcd6885adbffa828df4ccba236df4dd84/figure1-a-soccer-01.png" data-mid="33693053" border="0" src="https://freight.cargo.site/w/1000/i/b3c5be098f5729bfba61b4e188a77efdcd6885adbffa828df4ccba236df4dd84/figure1-a-soccer-01.png" /> DualPanto: a Haptic Device That Enables Blind Users to Continuously Interact with Virtual Worlds ACM UIST‘18 Oliver Schneider, Jotaro Shigeyama, Robert Kovacs, Thijs Jan Roumen, Sebastian Marwecki, Nico Boeckhoff, Daniel Amadeus Gloeckner, Jonas Bounama, Patrick Baudisch DualPanto is a haptic device that enables blind users to continuously track the absolute position of moving objects in spatial virtual environments, as is the case in sports or shooter games. ACM publication page US Patent&nbsp;US11510817B2 <img width="1023" height="576" width_o="1023" height_o="576" data-src="https://freight.cargo.site/t/original/i/c82a0909b8e456a4d6f7eae6cc17d91ab6bf517530d74804bb5473b54c4d6ebf/linespace.jpg" data-mid="30626787" border="0" src="https://freight.cargo.site/w/1000/i/c82a0909b8e456a4d6f7eae6cc17d91ab6bf517530d74804bb5473b54c4d6ebf/linespace.jpg" /> Linespace: a Sense Making Platform for the Blind ACM CHI‘16 Saiganesh Swaminathan, Thijs Roumen, Robert Kovacs, David Stangl, Stefanie Mueller, Patrick Baudisch Linespace is a tactile display system for blind users. The foundation of our system is a large 140x100cm display area, on which the system creates raised tactile lines with the help of a 3D printer. The foot switch allows users to enter text and issue commands by talking to the computer. ACM publication page haptic feedback in virtual reality <img width="1005" height="667" width_o="1005" height_o="667" data-src="https://freight.cargo.site/t/original/i/31d0a505c0c6b84af2f3f5c3e6c3f136d5eebac7afa66bf99b37f3e7f9062487/split-view-05.png" data-mid="30627745" border="0" src="https://freight.cargo.site/w/1000/i/31d0a505c0c6b84af2f3f5c3e6c3f136d5eebac7afa66bf99b37f3e7f9062487/split-view-05.png" /> Level-Ups: Motorized Stilts that Simulate Stair Steps in Virtual Reality ACM CHI‘16&nbsp;(note paper) Dominik Schmidt, Robert Kovacs, Vikram Mehta, Udayan Umapathi, Sven Köhler, Lung-Pan Cheng, Patrick Baudisch “Level-Ups” are computer-controlled stilts that allow virtual reality users to experience elevation in real-walking environment. ACM publication page <img width="1023" height="623" width_o="1023" height_o="623" data-src="https://freight.cargo.site/t/original/i/de730858cb60c4ba3b7dbeeaf6b0254f7238a3ba5bbed3fb36f9b05839813f45/csm_figure_11_6c2077550f.jpg" data-mid="30628550" border="0" src="https://freight.cargo.site/w/1000/i/de730858cb60c4ba3b7dbeeaf6b0254f7238a3ba5bbed3fb36f9b05839813f45/csm_figure_11_6c2077550f.jpg" /> TurkDeck: Physical Virtual Reality Based on People ACM UIST‘15 Lung-Pan Cheng, Thijs Roumen, Hannes Rantzsch, Sven Köhler, Patrick Schmidt, Robert Kovacs, Johannes Jasper, Jonas Kemper, and Patrick Baudisch TurkDeck is an immersive virtual reality system that reproduces not only what users see and hear, but also what users feel. TurkDeck creates these physical representations on the fly by making a group of human workers present and operate the props only when and where the user can actually reach them. ACM publication page cyber security PLC Guard: A Practical Defense Against Attacks on Cyber-Physical Systems IEEE CNS‘15 Jan-Ole Malchow, Daniel Marzin, Johannes Klick, Robert Kovacs, and Volker Roth Adversaries can then analyze and modify the code and load it back onto the PLC in order to perform sabotage. This process can be performed online or it can be automated by means of malware that infects engineering workstations, similar to Stuxnet. IEEE publication page art collaborations <img width="2000" height="1333" width_o="2000" height_o="1333" data-src="https://freight.cargo.site/t/original/i/c805024f52961c79c45263925749e187b21445bb850844b45b72f8d5052288a9/Ad-Infinitum-a-human-getting-trapped-in-the-cuffs-Arthur-Silber-photographer.jpg" data-mid="32627325" border="0" src="https://freight.cargo.site/w/1000/i/c805024f52961c79c45263925749e187b21445bb850844b45b72f8d5052288a9/Ad-Infinitum-a-human-getting-trapped-in-the-cuffs-Arthur-Silber-photographer.jpg" /> ad infinitum: a parasite that lives off human energy Ars Electronica Linz &amp; Science Galery Doublin Pedro Lopez, Robert Kovacs, Alexandra Ion, David Lindlbauer, and Patrick Baudisch&nbsp; Ad infinitum is a parasitical entity which lives untethered and off the grid. This parasite reverses the dominant role that mankind has with respect to technologies: the parasite shifts humans from “users” to “used” . <img width="1280" height="850" width_o="1280" height_o="850" data-src="https://freight.cargo.site/t/original/i/b4830bce3b8aae5bc3486a64581ba9e7c24a1be939d62f41674620643bc11eeb/photo_o.jpg" data-mid="32627275" border="0" src="https://freight.cargo.site/w/1000/i/b4830bce3b8aae5bc3486a64581ba9e7c24a1be939d62f41674620643bc11eeb/photo_o.jpg" /> pendulum tuning Museum Kiscell, Budapest, Hungary Turcsany Villő - artist Robert Kovacs - motion system The installation makes an attempt to change the personal perception of time. Four kinetic sculptures are suspended at the highest point of the temple space, allowing them to make pendulum movement. Their design represents advancement against the physical drag. The pendulums’ paths develop a moving structure and create a rhythm; they are constantly changing and thus re-tuneing the space of the viewer. https://robertkovax.com/trussformer-3D-printing-large-kinetic-structures Wed, 21 Oct 2020 16:59:27 +0000 dr robert kovacs https://robertkovax.com/trussformer-3D-printing-large-kinetic-structures TrussFormer: 3D printing large kinetic structures Robert Kovacs, Alexandra Ion, Pedro Lopes, Tim Oesterreich, Johannes Filter, Philip Otto, Tobias Arndt, Nico Ring, Melvin Witte, Anton Synytsia, and Patrick Baudisch In Proceedings of the 31th Annual ACM Symposium on User Interface Software and Technology (UIST ’18) paper: PDF ACM Digital Library TrussFormer is an integrated end-to-end system that allows users to 3D print large-scale kinetic structures, i.e., structures that involve motion and deal with dynamic forces. TrussFormer builds on TrussFab, from which it inherits the ability to create large-scale static truss structures from 3D printed hubs and PET bottles. TrussFormer incorporates linear actuators into these rigid truss structures in a way that they move “organically”, i.e., hinge around multiple points at the same time. These structures are also known as variable geometry trusses. This is illustrated on the on the example of a static tetrahedron that is converted into a moving structure by swapping one edge with a linear actuator. The only required change is to introduce connectors that enable rotation, i.e. hinges. <img width="2008" height="683" width_o="2008" height_o="683" data-src="https://freight.cargo.site/t/original/i/0cd0ba0d551f16217100a007fe147ac3dcc9e8ca80a22b744c289a1c907c3a1f/moving-tetranoletters-01.png" data-mid="86287738" border="0" src="https://freight.cargo.site/w/1000/i/0cd0ba0d551f16217100a007fe147ac3dcc9e8ca80a22b744c289a1c907c3a1f/moving-tetranoletters-01.png" /> TrussFormer creates these mechanisms in six basic steps: step 1: Creating the static structure. TrussFormer's editor’s ability to create static structures is based on TrussFab: users design the shape of their T-Rex using structurally stable primitives (tetrahedra and octahedra). <img width="2008" height="746" width_o="2008" height_o="746" data-src="https://freight.cargo.site/t/original/i/1e3d6b762c29dd278385405e0dd43c4bb6d0e463868f4b0046a31e3f0e87c7b8/modeling-dino-noletters-01.png" data-mid="86287739" border="0" src="https://freight.cargo.site/w/1000/i/1e3d6b762c29dd278385405e0dd43c4bb6d0e463868f4b0046a31e3f0e87c7b8/modeling-dino-noletters-01.png" /> step 2: Adding movement. TrussFormer provides three different approaches to animate the structures, ranging from (1) automated placement (for novice users), through (2) placing elements with predefined motion, called assets, to (3) manual placement (as users acquire engineering knowledge). To add movement using the demonstrate movement tool, users pull the T-Rex head downwards. TrussFormer responds by placing an actuator that turns the T-Rex body into a structure that can bend down, as shown in the figure below. <img width="5000" height="2048" width_o="5000" height_o="2048" data-src="https://freight.cargo.site/t/original/i/91f1679fc7f018e414043d72ae21544c3c33219c8fb09b9bd360cec4bbba20a3/demonstrate-movement-tool---large-01_o.png" data-mid="86287746" border="0" src="https://freight.cargo.site/w/1000/i/91f1679fc7f018e414043d72ae21544c3c33219c8fb09b9bd360cec4bbba20a3/demonstrate-movement-tool---large-01_o.png" /> step 3: Stability check across poses. During this step, TrussFormer verifies that the mechanism is structurally sound. In the background, TrussFormer finds the safe range of expansion and contraction of the placed actuator by simulating the occurring forces in a range of positions. If there is a pose where the forces exceed the pre-determined breaking limits or the structure would tip over, TrussFormer sets the limits for the actuator so it will not extend beyond them. This check prevents users from producing invalid configurations. step 4: Animation. To animate the structure users open the animation pane in the toolbar, as shown in the figure below. First, they control the movement of the structure manually using sliders, to try out the movement. When they find the desired pose, they simply add it as a keyframe to the animation timeline. With this TrussFormer allows users to orchestrate the movement of all actuators using a simple timeline/keyframe editor. Here, user programs a “feeding” behaviour, where the T-Rex opens its mouth while reaching down and waving its tail. <img width="800" height="450" width_o="800" height_o="450" data-src="https://freight.cargo.site/t/original/i/085a0a8925b76550a0409e14a50c3b41de7ebb5a3dc05efa724d46e4c692204f/t-rex_animated_800.gif" data-mid="86287747" border="0" src="https://freight.cargo.site/w/800/i/085a0a8925b76550a0409e14a50c3b41de7ebb5a3dc05efa724d46e4c692204f/t-rex_animated_800.gif" /> step 5: Checking the forces during the motion. Once the animation has been defined, TrussFormer computes the dynamic forces. In the figure below, (a) the user creates an animation that moves the T-Rex body up and down. (b) TrussFormer computes the forces while T-Rex’s body comes back up quickly after dipping down; the large acceleration of the long neck leads to very high inertial forces, exceeding the breaking limit of the construction, (c) causing the structure to fail at the indicated time point. These situations are hard to foresee, because the inertial forces can be multiple times higher than the static load in the structure. (d) TrussFormer addresses this by automatically correcting the animation sequence by either limiting the acceleration or the range of the movement, assuring that the structure will now withstand the movement. <img width="1507" height="1122" width_o="1507" height_o="1122" data-src="https://freight.cargo.site/t/original/i/f5fc61549910eedb4bdbb616adbe2f7a71bc9cb574230aab408b32bfaa07a8c7/forces-01.png" data-mid="86287742" border="0" src="https://freight.cargo.site/w/1000/i/f5fc61549910eedb4bdbb616adbe2f7a71bc9cb574230aab408b32bfaa07a8c7/forces-01.png" /> step 6: Fabrication. When users are satisfied with their design (structure, movement and animation), they click the fabricate button. This invokes (1) TrussFormer’s hinge generation algorithm, which analyzes the structure’s motion and generates the appropriate 3D printable hinge and hub geometries, annotated with imprinted IDs for assembly. In the case of the T-Rex, the system exports 42 3D printed hubs, consisting of 135 unique hinging pieces. <img width="2008" height="2017" width_o="2008" height_o="2017" data-src="https://freight.cargo.site/t/original/i/1e4467922d574aaedb663bee12b65fd309af32921bb39cfc2aecc9d625099e1c/figure-1-02.png" data-mid="86287750" border="0" src="https://freight.cargo.site/w/1000/i/1e4467922d574aaedb663bee12b65fd309af32921bb39cfc2aecc9d625099e1c/figure-1-02.png" /> (2) Next, TrussFormer exports the created animation patterns as Arduino code that users upload to their microcontroller. (3) Lastly, it outputs a specification file, containing the force, speed, and motion range of the actuators, in order to achieve the desired animation pattern. Users find these actuators as standardized components. <img width="800" height="450" width_o="800" height_o="450" data-src="https://freight.cargo.site/t/original/i/dea282e18bc0b0c23eb0023974c6cd6248515540b1a08b2690ca99d4d19d9f51/actuator_real_800px.gif" data-mid="86287748" border="0" src="https://freight.cargo.site/w/800/i/dea282e18bc0b0c23eb0023974c6cd6248515540b1a08b2690ca99d4d19d9f51/actuator_real_800px.gif" /> Conclusion Our main contribution is this end-to-end system that enables non-expert users to create large-scale kinetic structures, such as the devices used in large-scale animatronics. TrussFormer helps users in the 3 main steps along the design process. (1) It enables users to animate large truss structures by adding linear actuators to them. It offers three tools for this purpose: manual actuator placement, placement of assets performing predefined motion, and creating motion by demonstration. (2) TrussFormer validates the design in real time against static forces, static forces across all poses, and dynamic forces. (3) TrussFormer automatically generates the necessary 3D printable hinges for fabricating the structure. Its algorithm determines the placement and configuration of the hinges and their exact dimensions. Talk at UIST2018 more: official project page https://robertkovax.com/trussfab-fabricating-sturdy-large-scale-structures-on-desktop-3D Thu, 23 Mar 2017 17:46:08 +0000 dr robert kovacs https://robertkovax.com/trussfab-fabricating-sturdy-large-scale-structures-on-desktop-3D TrussFab: Fabricating Sturdy Large-Scale Structures on Desktop 3D Printers Robert Kovacs, Anna Seufert, Ludwig Wall, Hsiang-Ting Chen, Florian Meinel, Willi Müller, Si-jing You, Maximilian Brehm, Jonathan Striebel, Yannis Kommana, Alexander Popiak, Thomas Bläsius, and Patrick Baudisch In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’17) full paper: PDF ACM Digital Library 3D models on&nbsp;thingiverse TrussFab on Instructables TrussFab is an integrated end-to-end system that allows users to fabricate large scale structures that are sturdy enough to carry human weight. TrussFab achieves the large scale by complementing 3D print with plastic bottles. Unlike previous systems that stacked bottles as if they were “bricks”, TrussFab considers them as beams and uses them to form structurally sound node link structures based on closed triangles, also known as trusses. TrussFab embodies the required engineering knowledge, allowing non-engineers to design such structures. While freestanding bottles tend to break easily, truss structures essentially consist of triangles. In such an arrangement, it is the structure that prevents de-formation, not the individual bottle. The main strength of trusses is that they turn lateral forces (aka bending moments) into tension and compression forces along the length of the edges (aka members). Bottles make great members: while they buckle easily when pushed from the side, they are very strong when pushed or pulled along their main axis. TrussFab affords building trusses by combining tetrahedra and octahedra into so-called tetrahedral honeycomb structures. <img width="2014" height="516" width_o="2014" height_o="516" data-src="https://freight.cargo.site/t/original/i/f6e5c89d608b58a84fb0a3352b75745114b5aa75d78d88a552b5cb1b94a29e6c/truss-explained-nolabel-3-02.png" data-mid="29969831" border="0" src="https://freight.cargo.site/w/1000/i/f6e5c89d608b58a84fb0a3352b75745114b5aa75d78d88a552b5cb1b94a29e6c/truss-explained-nolabel-3-02.png" /> Walkthrough of the TrussFab system step 1: Automatic conversion. One way to create TrussFab structures is to convert an existing 3D model using Truss-Fab’s converter. As shown in the figure below, this converts the volume of the model into a tetrahedral honeycomb structure, allowing it to bear substantial load. <img width="1939" height="900" width_o="1939" height_o="900" data-src="https://freight.cargo.site/t/original/i/1480fd37da7b9b75da0c29763dadea585551ca373606c9cb515b88abaaf9eb23/table-convert-nolable-02.png" data-mid="29969832" border="0" src="https://freight.cargo.site/w/1000/i/1480fd37da7b9b75da0c29763dadea585551ca373606c9cb515b88abaaf9eb23/table-convert-nolable-02.png" /> step 2: Editing. We implemented TrussFab’s editor as an extension to the 3D modeling software SketchUp. TrussFab’s editor offers all the functionalities of the original SketchUp system, plus custom functions that help users create sturdy structures. In particular, TrussFab’s editor offers primitives that are elementary trusses (tetrahedra and octahedra), tools that create large beams in the form of trusses, and tools for tweaking the shape of structures, while maintaining their truss structure. TrussFab’s integrated structural analysis calculates the internal forces in the structure and warns users if it would brake. <img width="1936" height="1138" width_o="1936" height_o="1138" data-src="https://freight.cargo.site/t/original/i/4a90f26c65356d739bef35f5eda1f5b6f58e43f66b0fcd378b5435346942ab98/chair-FEA-nolable-02.png" data-mid="29969833" border="0" src="https://freight.cargo.site/w/1000/i/4a90f26c65356d739bef35f5eda1f5b6f58e43f66b0fcd378b5435346942ab98/chair-FEA-nolable-02.png" /> step 3: Hub generation. After designing a structure, TrussFab’s hub generator generates the 3D models of all hubs. The system genarates 3D printable hubs for spacial structures and laser-cuttable 2D hubs for facades, as shown in the figure below. <img width="1793" height="871" width_o="1793" height_o="871" data-src="https://freight.cargo.site/t/original/i/65e62351293872bedf53a1aac1574b5b30bd2880da7af932e8bab64370f423e9/labeling-new-nolable1-03.png" data-mid="29969834" border="0" src="https://freight.cargo.site/w/1000/i/65e62351293872bedf53a1aac1574b5b30bd2880da7af932e8bab64370f423e9/labeling-new-nolable1-03.png" /> step 4: Fabrication. Users then send the 3D model files produced by the hub generator to one or more 3D printers in order to manufacture them. step 5: Assembly. Users finally manually assemble their structures by following the unique IDs embossed into each hub. We have validated our system by designing and fabricating tables and chairs, a 2.5 m bridge strong enough to carry a human, and a 5 m high pavilion consisting of 1280 bottles and 191 3D printed hubs, presented at CHI'17 in Denver. Daily Planet documented the building process of the pavilion at CHI2017 Conclusion TrussFab is an integrated end-to-end system that allows users to fabricate large structures that are sturdy enough to carry human weight on desktop 3D printers. Unlike previ-ous systems that built on up-cycled plastic bottles com-bined with 3D print, TrussFab considers bottles not as “bricks”, but as beams that form structurally sound node link structures also known as trusses, allowing users to handle the forces resulting from scale and load. TrussFab embodies the required engineering knowledge, allowing non-engineers to design such structures and allows users to validate their designs using integrated structural analysis. official project page media article on ArchDaily If you are interested in trying out our beta software, drop me an email: robertkovax@yahoo.com https://robertkovax.com/protopiper-physically-sketching-room-sized-objects-at-actual-scale Tue, 28 Jul 2015 13:57:13 +0000 dr robert kovacs https://robertkovax.com/protopiper-physically-sketching-room-sized-objects-at-actual-scale Protopiper: Physically Sketching Room-Sized Objects at Actual Scale Harshit Agrawal, Udayan Umapathi, Robert Kovacs, Johannes Frohnhofen, Hsiang-Ting Chen, Stefanie Mueller, Patrick Baudisch In Proceedings of the 28th Annual ACM Symposium on User Interface Software &amp; Technology (UIST ’15). full paper: ACM digital library, PDF make it on instructables Protopiper is a computer aided, hand-held fabrication device that allows users to sketch room-sized objects at actual scale. The key idea behind protopiper is that it forms adhesive tape into tubes as its main building material, rather than extruded plastic or photopolymer lines. Since the resulting tubes are hollow they offer excellent strength-to-weight ratio, thus scale well to large structures. <img width="1600" height="1212" width_o="1600" height_o="1212" data-src="https://freight.cargo.site/t/original/i/4be9705185e04f9494dcde4de9efce3e770200837840f0220f7c15bd28e6b895/kitchen-processed2.jpg" data-mid="29969842" border="0" src="https://freight.cargo.site/w/1000/i/4be9705185e04f9494dcde4de9efce3e770200837840f0220f7c15bd28e6b895/kitchen-processed2.jpg" /> The device itself is an assembly line: the tape is drawn from the roll, shaped into a tube, sealed together, and finally cut off. <img width="1200" height="800" width_o="1200" height_o="800" data-src="https://freight.cargo.site/t/original/i/3a4cfbc8657b0b84a65e38f1a01b9db9472909160517f172b732a4f2f1785024/device1-s.jpg" data-mid="29969840" border="0" src="https://freight.cargo.site/w/1000/i/3a4cfbc8657b0b84a65e38f1a01b9db9472909160517f172b732a4f2f1785024/device1-s.jpg" /> Protopiper provide the tubes with highly versatile wing connectors—one at each end. Wing connectors connect tubes to flat or curved surfaces, such as walls or ceilings, or other tubes. <img width="2415" height="795" width_o="2415" height_o="795" data-src="https://freight.cargo.site/t/original/i/c80768dd596506d47c0727cc50c71fd6938217407dc1e29df9bd923e0040013b/tube-connectors0w.jpg" data-mid="29969843" border="0" src="https://freight.cargo.site/w/1000/i/c80768dd596506d47c0727cc50c71fd6938217407dc1e29df9bd923e0040013b/tube-connectors0w.jpg" /> Protopiper’s tubes also afford creating simple mechanisms. By creasing them, for example, users form hinges. Hinges allow for moving mechanisms, like the opening-closing umbrella. <img width="1200" height="593" width_o="1200" height_o="593" data-src="https://freight.cargo.site/t/original/i/bcba86cf00ef4ae22bce26be953502753e8b11fcfd583dd5e9072bc0a71ae492/umbrella.jpg" data-mid="29969841" border="0" src="https://freight.cargo.site/w/1000/i/bcba86cf00ef4ae22bce26be953502753e8b11fcfd583dd5e9072bc0a71ae492/umbrella.jpg" /> Protopiper works equally well for freeform expression, such as the T-Rex sculpture. <img width="1200" height="826" width_o="1200" height_o="826" data-src="https://freight.cargo.site/t/original/i/bd989298153914d6d04127da88e8cff01a839bcf1fbfe632f45e1c1f1e5a1a34/godzilla2.jpg" data-mid="29969837" border="0" src="https://freight.cargo.site/w/1000/i/bd989298153914d6d04127da88e8cff01a839bcf1fbfe632f45e1c1f1e5a1a34/godzilla2.jpg" /> presentation at UIST 2015 more GIZMODO article official project page https://robertkovax.com/Haptic-PIVOT-On-Demand-Handhelds-in-VR Wed, 29 Aug 2018 19:31:26 +0000 dr robert kovacs https://robertkovax.com/Haptic-PIVOT-On-Demand-Handhelds-in-VR Haptic PIVOT: On-Demand Handhelds in VR Robert Kovacs, Eyal Ofek, Mar Gonzalez Franco, Alexa Fay Siu, Sebastian Marwecki, Christian Holz, and Mike Sinclair In Proceedings of the 33th Annual ACM Symposium on User Interface Software and Technology (UIST ’20) paper: PDF ACM Digital Library ABSTRACT Hapric PIVOT is a wrist-worn haptic device that renders virtual objects into the user’s hand on demand. Its simple design comprises a single actuated joint that pivots a haptic handle into and out of the user’s hand, rendering the haptic sensations of grasping, catching, or throwing an object – anywhere in space. Unlike existing hand-held haptic devices and haptic gloves, PIVOT leaves the user’s palm free when not in use, allowing users to make unencumbered use of their hand. PIVOT also enables rendering forces acting on the held virtual objects, such as gravity, inertia, or air-drag, by actively driving its motor while the user is firmly holding the handle. When wearing a PIVOT device on both hands, they can add haptic feedback to bimanual interaction, such as lifting larger objects. In our user study, participants (n=12) evaluated the realism of grabbing and releasing objects of different shape and size with mean score 5.19 on a scale from 1 to 7, rated the ability to catch and throw balls in different directions with different velocities (mean=5.5), and verified the ability to render the comparative weight of held objects with 87% accuracy for ~100g increments. Presentation at UIST’20 <img width="950" height="534" width_o="950" height_o="534" data-src="https://freight.cargo.site/t/original/i/1b51ceb69d63611737f366a84faf0516e10afda4a65c2dced6aeb8fcd6a32809/presentation_youtube.png" data-mid="117766709" border="0" src="https://freight.cargo.site/w/950/i/1b51ceb69d63611737f366a84faf0516e10afda4a65c2dced6aeb8fcd6a32809/presentation_youtube.png" /> PIVOT’s key benefits: &nbsp; catching and throwing flying objects &nbsp; grasping and releasing stationary objects &nbsp; simulates dynamic forces provided by the grabbed object such as weight, inertia, or drag &nbsp; leaves the users palm completely free for real-world perations <img width="2708" height="1706" width_o="2708" height_o="1706" data-src="https://freight.cargo.site/t/original/i/81e87ab0c19e4823d5048d40389dbda6ad6a39d48062fb943e1a0da96716338c/figure-1b-nolabel-01.png" data-mid="86289286" border="0" src="https://freight.cargo.site/w/1000/i/81e87ab0c19e4823d5048d40389dbda6ad6a39d48062fb943e1a0da96716338c/figure-1b-nolabel-01.png" /> PIVOT’s handle acts as a generic proxy while additionally offering similar ergonomics and functionality as conventional VR controllers, including touch sensing, a trigger button, and vibrotactile feedback. The device design includes a back-drivable motorized hinge for the flexing wrist movement and an additional passive radioulnar hinge that enables the hand to move sideways (here: up-down) while holding the handle. <img width="2008" height="1164" width_o="2008" height_o="1164" data-src="https://freight.cargo.site/t/original/i/836b62a66f5956be02ceb9fe5261c8674fa3db78f31c79888a35b77b2b889e7d/figure-2-01.png" data-mid="86292186" border="0" src="https://freight.cargo.site/w/1000/i/836b62a66f5956be02ceb9fe5261c8674fa3db78f31c79888a35b77b2b889e7d/figure-2-01.png" /> Touching and grasping virtual objectsPIVOT’s main capability is rendering haptic sensations for acquiring, grasping and releasing virtual objects. When the user reaches for an object, PIVOT moves its handle towards the user’s hand proportionally with the distance to the virtual object. As a result, PIVOT’s handle touches the user’s hand in synchrony with the virtual object. Catching and throwing Using its quick actuation mechanisms, PIVOT can naturally render haptic feedback in response to throwing and catching virtual objects. The main difference to grasping stationary objects is in PIVOT’s process loop that predicts the contact with the flying object. When a potential object is flying towards the hand, PIVOT starts moving the handle in advance, accounting for the latency of the system and placing it in the user’s hand at the time the user expects the object to make contact. <img width="1756" height="621" width_o="1756" height_o="621" data-src="https://freight.cargo.site/t/original/i/40a1f557e73c7b3259c45ccda9b18e35f6abf0f4e7da73031645993421e2d715/figure-9-1-03.png" data-mid="86294282" border="0" src="https://freight.cargo.site/w/1000/i/40a1f557e73c7b3259c45ccda9b18e35f6abf0f4e7da73031645993421e2d715/figure-9-1-03.png" /> Force rendering In addition to touch feedback, PIVOT can produce a sensation of dynamic forces acting on the handheld virtual object, like gravity, springiness, inertia or drag. It does this by continuously actuating its handle motor, while it is firmly grasped by the user. <img width="2036" height="1220" width_o="2036" height_o="1220" data-src="https://freight.cargo.site/t/original/i/577963fa1655285b5d7cf9a545f251c2346e7e696f0c88cb7e7d225905ccfa3f/figure-7---forces-nolable-01.png" data-mid="86293850" border="0" src="https://freight.cargo.site/w/1000/i/577963fa1655285b5d7cf9a545f251c2346e7e696f0c88cb7e7d225905ccfa3f/figure-7---forces-nolable-01.png" /> An example for rendering force feedback for dynamic animated objects, such as a wiggling bunny. User perceives the inertia of the wiggling bunny through quickly actuating PIVOT’s handle back and forth. <img width="1875" height="715" width_o="1875" height_o="715" data-src="https://freight.cargo.site/t/original/i/d8f8643a27da1ac7bf5a09260f4098a4c0decadc6adde3c79caa9bd605149ab1/figure-7---forces-nolable-01-02.png" data-mid="86293855" border="0" src="https://freight.cargo.site/w/1000/i/d8f8643a27da1ac7bf5a09260f4098a4c0decadc6adde3c79caa9bd605149ab1/figure-7---forces-nolable-01-02.png" /> PIVOT also supports two-handed operation to render haptic feedback in response to larger and heavier virtual objects. Because the device cannot physically constrain the two hands to each other, it renders large objects as compliant and applies coupled force feedback on both hands. <img width="1875" height="803" width_o="1875" height_o="803" data-src="https://freight.cargo.site/t/original/i/9854f75abca2f437b8acf97db8cc35458efc4f147e28ee5cc4631c9e1e3f7231/figure-7---forces-03.png" data-mid="86293843" border="0" src="https://freight.cargo.site/w/1000/i/9854f75abca2f437b8acf97db8cc35458efc4f147e28ee5cc4631c9e1e3f7231/figure-7---forces-03.png" /> Free-hand use and summoning on-demandOne of PIVOT’s key benefits is that it lets users use their hands freely. As shown in Figure 8a, the folded idle state affords free‑hand interaction, such as resting the hand on the table, operating tangible objects, such as a keyboard and mouse, or placing up the headphones <img width="2008" height="614" width_o="2008" height_o="614" data-src="https://freight.cargo.site/t/original/i/c0af6e6194ed21f809ddfab7df9cd6dc63c6c82b34c4629a4c782ff272bcb089/figure-5-2-01.png" data-mid="86292645" border="0" src="https://freight.cargo.site/w/1000/i/c0af6e6194ed21f809ddfab7df9cd6dc63c6c82b34c4629a4c782ff272bcb089/figure-5-2-01.png" /> Hardware The servo actively pivots the handle around the slanted vertical axis, while the handle affords passive radioulnar motion to accommodate natural hand tilting. A sliding rail mount on the hand-cuff enables adjustment to individual hand sizes. <img width="2854" height="792" width_o="2854" height_o="792" data-src="https://freight.cargo.site/t/original/i/5c5dcceb100c4b43a943982d9747d028dda4296cc50507a19fb8c38fd8bbf774/figure-10-1-02.png" data-mid="86294804" border="0" src="https://freight.cargo.site/w/1000/i/5c5dcceb100c4b43a943982d9747d028dda4296cc50507a19fb8c38fd8bbf774/figure-10-1-02.png" /> The passive, friction based radioulnar hinge enables the hand to move when holding the handle (here: up-down). <img width="1555" height="496" width_o="1555" height_o="496" data-src="https://freight.cargo.site/t/original/i/7f2a7c09c552f4ba14cee7535c5aa7a0d97b19a935394efc615cf84073272950/figure-10-2-02.png" data-mid="86295120" border="0" src="https://freight.cargo.site/w/1000/i/7f2a7c09c552f4ba14cee7535c5aa7a0d97b19a935394efc615cf84073272950/figure-10-2-02.png" /> The device is equipped with a 32 bit, 180 MHz Teensy 3.6 microcontroller that controls the servo motor, gathers the sensory information and communicates with the PC. <img width="1369" height="714" width_o="1369" height_o="714" data-src="https://freight.cargo.site/t/original/i/803ae5cf67d24a814ff88e6e07a371713a9b01325373737db5b68c6b704a4309/figure-10-1-01.png" data-mid="86295130" border="0" src="https://freight.cargo.site/w/1000/i/803ae5cf67d24a814ff88e6e07a371713a9b01325373737db5b68c6b704a4309/figure-10-1-01.png" /> The inside of the handle containing the trigger, capacitive sensing, and the VCA. We use the Teensy’s built-in active loading capacitive sensing functionality to detect touch on the copper-based patches placed on the inside of the handle at four distinct locations. The handle also contains a VCA to render vibrotactile feedback as well as a trigger button as commonly found in VR controllers. <img width="1369" height="742" width_o="1369" height_o="742" data-src="https://freight.cargo.site/t/original/i/06636755af80812ff34c4e5775fbdfcf139084213a105fd46818a3eefb643653/figure-14-01.png" data-mid="86295136" border="0" src="https://freight.cargo.site/w/1000/i/06636755af80812ff34c4e5775fbdfcf139084213a105fd46818a3eefb643653/figure-14-01.png" /> User study We conducted a user study to evaluate PIVOT’s ability to simulate: (1) grasping sensation for a variety of objects, (2) catching &amp; throwing of objects at different speeds and directions, and (3) perceptual illusion of weight of an object. We recruited twelve participants (ages 19-26, mean=22). Each participant performed a series of tasks inside VR using PIVOT. After each task, participants also completed an offline questionnaire. Task 1: Grasping objects of various shape and size In the first task, we measured PIVOT’s ability to render a grasping sensation. We asked participants to reach towards, grab, move and release virtual objects of different size (Figure 15, 1-4) and shape (5-9). Note the size range includes the diameter of the handle of the wrench and the handle of the cup, but not the full object. <img width="1330" height="607" width_o="1330" height_o="607" data-src="https://freight.cargo.site/t/original/i/8fcf82dcbc514925e046f91d6ce9f1d1153eaf4753f58edf209a90eacc3fa5e7/task-1-1.png" data-mid="86295164" border="0" src="https://freight.cargo.site/w/1000/i/8fcf82dcbc514925e046f91d6ce9f1d1153eaf4753f58edf209a90eacc3fa5e7/task-1-1.png" /> Participants rated their experience in response to the question “How realistic does the grab &amp; hold haptic experience feel?” on a 1 (not real at all) to 5 (very realistic) Likert scale directly inside the HMD. Participants found it realistic (average score 3.9) to hold spheres of 5 cm (the most similar shape to PIVOT’s handle, o3) and within a tolerance of ±2cm in diameter (o2). Objects beyond this range (o1 and o4) were not perceived as realistic (V = 66, p &lt;&nbsp;0.01). This indicates that users accept slight discrepancies between the visual and actual size of objects. Task 2: Catching and throwing virtual objectsIn the second task, we measured PIVOT’s ability to enable catching and throwing. In addition, were aiming to identify potential ergonomic differences while catching and throwing a ball coming from different directions. Even though PIVOT moves together with the user’s hand in space, there are certain anatomic differences in catching and throwing when the palm is facing upwards, downwards, to the front or to the side. We tasked participants to catch a virtual ball thrown at them from two meters away coming from four different directions (front, side, down, up). <img width="823" height="327" width_o="823" height_o="327" data-src="https://freight.cargo.site/t/original/i/624d549f0780e9acc7d45e60df95da5aabea7513fbe3db1ba8dfeeb2aac67bfd/catch-throw-dirrections.png" data-mid="86295163" border="0" src="https://freight.cargo.site/w/823/i/624d549f0780e9acc7d45e60df95da5aabea7513fbe3db1ba8dfeeb2aac67bfd/catch-throw-dirrections.png" /> Catching: Participants found the haptic experience for catching realistic (Figure 17), with an average score of 3.5 ±1 (mean, sd). No significant differences were found for the direction of the ball, despite the balls coming from the front were found a bit the less realistic (avg score = 3.3), most likely because of the ergonomics of the device. Participants found catching faster balls more realistic (Pearson correlation of r=0.25, p &lt;&nbsp;0.01). We did not simulate gravity, which, with the slow balls, might have been more apparent. Throwing: Participants found the haptic experience of throwing more realistic than that of catching (Wilcoxon signed rank paired test p &lt; 0.001), with an average score of 4 ±1 (mean, sd). The reason for this might be the previously described importance of self-generated actions for haptic acceptance [5]. No significant differences were found in the realism between throwing to the side, up and to the front. Only for the down direction we found a significant negative correlation (r=-0.31, p &lt;&nbsp;.05). Further investigation would be necessary to understand this effect. For the three other directions, the correlation of speed and realism was maintained: the fastest the throw the more realistic it seemed (Pearson correlation r=0.24, p&nbsp;&lt;&nbsp;0.01). Task 3: Perception of weight In the last task, we measured PIVOT’s ability to produce the perception of weight. We asked participants to grab three different virtual balls and select the one they perceived to be heaviest and the one they found the lightest (Figure 18). Participants naturally assessed the balls weight by holding the balls upwards, downwards, turning them, and weighting with up-down movements. The rendered weights of the objects were 90g, 200g and 300g (the force exerted at the end of the handle lever). Similarly as illustrated in Figure 5, the device was rendering only the perpendicular component of the gravitational force to the plane of the palm. This resulted in full weight sensation when the palm was facing upwards or downwards, and proportionally less in the in-between positions. <img width="787" height="526" width_o="787" height_o="526" data-src="https://freight.cargo.site/t/original/i/40146e8a47f6fb05906c376942ee47dda3060ad9e8b104e6457a722944e0c424/weights_results.png" data-mid="86295165" border="0" src="https://freight.cargo.site/w/787/i/40146e8a47f6fb05906c376942ee47dda3060ad9e8b104e6457a722944e0c424/weights_results.png" /> Overall, there was a slight tendency to overestimate the weight. This could be a normal human tendency or a fatigue effect. Two participants were clear outliers in overestimating. Conclusion In this paper, we presented a novel interactive haptic device for use in AR and VR scenarios. Unlike existing commercial controllers and haptic devices presented in recent research projects, PIVOT presents an approach that dynamically appears and vanishes a haptic proxy in the user’s palm. This enables compelling haptic effects and force rendering, as well as free-hand interactions with physical objects in the real world. What enables PIVOT’s unique capability is a forearm-grounded pivoting mechanism that rotates a handle into and out of the user’s palm on demand. We demonstrated several use-cases of this key feature in this paper, such as grasping, catching, and throwing virtual objects, which PIVOT renders in an analog manner. In addition, our controller enables rendering dynamic forces excreted by the grasped objects. In our user study, participants rated the use of PIVOT as a realistic proxy and highlighted the ergonomics of the design that made them feel like their hand was in direct contact with the object. These results support PIVOT’s potential for future use. more at: Microsoft Research blog post https://robertkovax.com/FormFab-Towards-Shape-Exploration-in-Interactive-Fabrication Sat, 12 Jan 2019 11:06:15 +0000 dr robert kovacs https://robertkovax.com/FormFab-Towards-Shape-Exploration-in-Interactive-Fabrication FormFab: Towards Shape Exploration in Interactive Fabrication Stefanie Mueller, Anna Seufert, Huaishu Peng, Robert Kovacs, Kevin Reuss, François Guimbretière, Patrick Baudisch In Proc. TEI'19. Full Paper paper: PDF ACM Digital Library FormFab is an interactive fabrication system that can change a workpiece’s shape continuously while the user is interacting. This enables users to explore different sizes of a shape with a single interaction rather than in multiple turns. We accomplish this using a process called formative fabrication, which rather than adding or subtracting, reshapes the existing material. In our system, users interactively control a pneumatic air pump that applies either pressure or vacuum to a compliant thermoplastic sheet, thereby pushing the material outwards or pulling it inwards. <img width="740" height="267" width_o="740" height_o="267" data-src="https://freight.cargo.site/t/original/i/8cfeae3cd32f3cb5cdf7ffd96be0fc1d8162718e828e85ad37d047d4cfdf9f83/pulling-copy-4.jpg" data-mid="32527769" border="0" src="https://freight.cargo.site/w/740/i/8cfeae3cd32f3cb5cdf7ffd96be0fc1d8162718e828e85ad37d047d4cfdf9f83/pulling-copy-4.jpg" /> To achieve this, FormFab does not add or subtract material but instead reshapes it (formativefabrication). A heat gun attached to a robotic arm warms up a thermoplastic sheet until it becomes compliant; users then control a pneumatic system that applies either pressure or vacuum thereby pushing the material outwards or pulling it inwards. <img width="2001" height="834" width_o="2001" height_o="834" data-src="https://freight.cargo.site/t/original/i/5f55d8ad81a4f395ba322191283adc1584e95e2ec172aa9e6e04d18dc16aba1a/tochi.png" data-mid="32527771" border="0" src="https://freight.cargo.site/w/1000/i/5f55d8ad81a4f395ba322191283adc1584e95e2ec172aa9e6e04d18dc16aba1a/tochi.png" /> First, users draw an outline&nbsp;of the area they want to reshape using their index finger. When the user removes the finger, the path is beautified by our software. The&nbsp;robotic arm then warms up the areausing a heat gun. After the material has reached its compliance point, the robotic arm moves out of the way. The user can then perform a pinch gesture, which activates the pneumatic system. If the user’s hand moves away from the workpiece, the pneumatic system increases the air pressure and&nbsp;the compliant area inflates. <img width="1048" height="592" width_o="1048" height_o="592" data-src="https://freight.cargo.site/t/original/i/83ff1dbacaf855b1bd8ce0b0b7696d10d18589bb8afae7d5667e16072b8e0ab5/final-teddy.jpg" data-mid="32527864" border="0" src="https://freight.cargo.site/w/1000/i/83ff1dbacaf855b1bd8ce0b0b7696d10d18589bb8afae7d5667e16072b8e0ab5/final-teddy.jpg" /> To track the user interaction, FormFab users wear a motion capture marker and a pressure sensor on their index finger. The marker is detected by a motion capture system (OptiTrack) and used to determine wherethe user is interacting on the workpiece. In addition, the pressure sensor is used to determine the beginning and end of the interaction. <img width="1057" height="936" width_o="1057" height_o="936" data-src="https://freight.cargo.site/t/original/i/d49b6989466e6ddea79962961374858a411f324df55dae8ab3d77dca5e52faba/finger-tracking.png" data-mid="32527874" border="0" src="https://freight.cargo.site/w/1000/i/d49b6989466e6ddea79962961374858a411f324df55dae8ab3d77dca5e52faba/finger-tracking.png" /> To reshape the workpiece, FormFab uses a compressed air. The&nbsp;air is&nbsp;guided through different valves, depending on whether pressure or vacuum should be appliedto the workpiece. <img width="1063" height="837" width_o="1063" height_o="837" data-src="https://freight.cargo.site/t/original/i/7e115fec69d8f67ceaa92469da946a365f6d67811219a4b8a184e615165f172f/pneumatic-system.png" data-mid="32527895" border="0" src="https://freight.cargo.site/w/1000/i/7e115fec69d8f67ceaa92469da946a365f6d67811219a4b8a184e615165f172f/pneumatic-system.png" /> Conclusion In this paper, we showed a first prototype implementation of an interactive fabrication system that provides the user with physical feedback while the user is interacting. While the first step of selecting the area still followed the turntaking model, the second step of defining the size of the shape provided the user with simultaneous physical feedback, thereby bringing the principles of direct manipulation to the editing of physical objects. More Information:https://hpi.de//baudisch/projects/formfab.html https://hcie.csail.mit.edu/research/formfab/formfab.html https://robertkovax.com/dualpanto-a-haptic-device-that-enables-blind-users-to-continuously Thu, 11 Oct 2018 14:58:03 +0000 dr robert kovacs https://robertkovax.com/dualpanto-a-haptic-device-that-enables-blind-users-to-continuously Dualpanto: A Haptic Device That Enables Blind Users to Continuously Interact With Virtual Worlds Oliver Schneider, Jotaro Shigeyama, Robert Kovacs, Thijs Jan Roumen, Sebastian Marwecki, Nico Boeckhoff, Daniel Amadeus Gloeckner, Jonas Bounama, Patrick Baudisch In Proceedings of the 31th Annual ACM Symposium on User Interface Software and Technology (UIST ’18) paper: PDF ACM Digital Library DualPanto is a haptic device that enables blind users to track moving objects while acting in a virtual world. <img width="2966" height="1620" width_o="2966" height_o="1620" data-src="https://freight.cargo.site/t/original/i/06923575f80d9061a2312360ebbfa98d6efbcd0a722ceed945920e163bd1aedc/figure1-a-soccer-01.png" data-mid="33722562" border="0" src="https://freight.cargo.site/w/1000/i/06923575f80d9061a2312360ebbfa98d6efbcd0a722ceed945920e163bd1aedc/figure1-a-soccer-01.png" /> As shown in the figure abowe (b), the device features two handles. Users interact with DualPanto by actively moving the me handle with one hand and passively holding on to the it handle with the other. DualPanto applications generally use the me handle to represent the user’s avatar in the virtual world and the it handle to represent some other moving entity, such as the opponent in a soccer game. interacting with DualPanto <img width="740" height="418" width_o="740" height_o="418" data-src="https://freight.cargo.site/t/original/i/4cd055fde2bcf4b9d5df4369adec44e60579deafd34d73ba371bec8553cb61c8/fig-3.png" data-mid="29969846" border="0" src="https://freight.cargo.site/w/740/i/4cd055fde2bcf4b9d5df4369adec44e60579deafd34d73ba371bec8553cb61c8/fig-3.png" /> me handle: As shown in the figure above, DualPanto’s applications generally use the me handle to represent the user’s avatar in the virtual world. (a) The user moves around and explores the virtual environment, such as a series of rooms in a shooter game, by moving the me handle. The device uses a direct 1:1 mapping, similar to the mapping of a touch screen; returning the handle to the same location in the physical world returns the avatar to same location in the virtual world. (b) The knob itself allows users to rotate their avatar. The pointed end of the handle represents the direction the avatar faces. (c) When the user pushes against a wall, the me handle resists by providing force feedback. (d) The me handle plays back haptic icons, for example, a short knockback when the player is hit by a projectile. <img width="740" height="219" width_o="740" height_o="219" data-src="https://freight.cargo.site/t/original/i/06d551318ef7967e94e71c1f07c087c19bc800b0bc6a2f3c11f2b92f2af50be3/fig4.png" data-mid="29969847" border="0" src="https://freight.cargo.site/w/740/i/06d551318ef7967e94e71c1f07c087c19bc800b0bc6a2f3c11f2b92f2af50be3/fig4.png" /> it handle: As shown in the figure above, DualPanto applications use the it handle to render one selected moving object, such as the opponent in a first-person shooter. (a) If the object represented by the it handle moves, so does the handle. The handle is actuated only by the device, i.e., it will resist users trying to move it. By allowing the it handle to guide their hand, users can track the associated object, e.g., feel how the opponent moves and obtain a sense of where it is currently located with respect to the user’s avatar. (b) At the same time, the actuated knob conveys to the user what direction it is facing. The it handle may also display haptic icons, such as an impulse when the opponent is shot. hardware implementation <img width="650" height="491" width_o="650" height_o="491" data-src="https://freight.cargo.site/t/original/i/e8cf6e30325b18549de538f21279e9e59f1b09d6bfdb27ed4c72375b1916661d/fig6_4.jpeg" data-mid="29969851" border="0" src="https://freight.cargo.site/w/650/i/e8cf6e30325b18549de538f21279e9e59f1b09d6bfdb27ed4c72375b1916661d/fig6_4.jpeg" /> DualPanto implements the haptic pantograph design. We chose this design because it is planar and therefore appropriate for a single registered workspace without collisions; the two pantographs operate independently, unlike constructions where two pantographs control a single end-effector. We based our implementation on the open-source Haply platform. The two pantographs are mounted individually onto a tripod using a 3D-printed bracket. We typically weight the tripod’s legs to improve stability. The linkages are made of 3 mm laser-cut aluminum, which is rigid enough to avoid deflection. This maintains the vertical distance between the two handles. The me and it handles are mounted to the arms of the pantographs by a 3D-printed bracket. The me handle contains a small motor (Pololu, 6V) with a gear ratio of 10:1, which is easily back-drivable for user input. The it handle has a higher gear ratio of 75:1 to provide enough force for system output. To represent direction, we mounted a 3D-printed, asymmetric tip onto each of DualPanto’s handles. After experimenting with several designs, the “flattened teardrop” design (8x10x15 mm) performed best, in that holding this design between index finger and thumb clearly conveys its orientation any time. conclusion We presented DualPanto, a haptic device that enables blind users to interact with spatial virtual environments that contain objects moving in real-time, as is the case in sports or shooter games. The key feature is that its two haptic in/output handles are spatially registered to each other, which enables blind players to navigate, track, dodge, and aim. In our user study, blind participants reported very high enjoyment when playing a soccer game (6.5/7). https://robertkovax.com/linespace-a-sense-making-platform-for-the-blind Thu, 06 Oct 2016 15:59:23 +0000 dr robert kovacs https://robertkovax.com/linespace-a-sense-making-platform-for-the-blind Linespace: A Sense Making Platform for the Blind Saiganesh Swaminathan, Thijs Roumen, Robert Kovacs, David Stangl, Stefanie Mueller, Patrick Baudisch In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’16) full paper: ACM digital library, PDF Linespace is a tactile display system for blind users. The foundation of our system is a large 140x100cm display area, on which the system creates raised tactile lines with the help of a 3D printer. The foot switch allows users to enter text and issue commands by talking to the computer. We use Linespace to give blind users access to the type of software packages that normally only sighted people can access, namely the type of software that helps them to make sense of complex data. So far, we have created a simple homefinder program, a spreadsheet program that can read and write Microsoft Excel, two simple games, and a simple programming environment. One might say that lineSpace is an interactive "visualization" system for the blind. The key to achieving this is Linespace' large display as it allows displaying a lot of contents at once, where smaller display systems need to update screen contents. The use of lines (instead of the more common Braille dots) helps create visualizations. <img width="1279" height="770" width_o="1279" height_o="770" data-src="https://freight.cargo.site/t/original/i/2194da894d869578369c096946b9a2560fcf496c02cc0f8cdee96074097a6085/linespace-touch.PNG" data-mid="29969854" border="0" src="https://freight.cargo.site/w/1000/i/2194da894d869578369c096946b9a2560fcf496c02cc0f8cdee96074097a6085/linespace-touch.PNG" /> The vision behind linespace is to help blind users interact with and make sense of complex spatial data. It thereby intends to pick up the vision behind of Vannevar Bush's memex, Engelbart Online system, and Xerox PARC's personal computer, by investigating how we can recreate this type of interaction for blind users--how to use computers to help people think better. Linespace' print head is borrowed from a 3D printer. During operation, it squeezes liquid PLA plastic onto the display, resulting in raised lines that users can feel using their fingertips. The same print head also offers a scraper that can remove lines under computer control. <img width="1023" height="576" width_o="1023" height_o="576" data-src="https://freight.cargo.site/t/original/i/6bd5e19df107803edddf60e3c009c823bc6a2a9626bfcb57f01d8350c39306f0/linespace_printhead_filament.jpg" data-mid="29969853" border="0" src="https://freight.cargo.site/w/1000/i/6bd5e19df107803edddf60e3c009c823bc6a2a9626bfcb57f01d8350c39306f0/linespace_printhead_filament.jpg" /> publication: Saiganesh Swaminathan, Thijs Roumen, Robert Kovacs, David Stangl, Stefanie Mueller, and Patrick Baudisch. 2016. Linespace: A Sensemaking Platform for the Blind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2175-2185. DOI: https://dx.doi.org/10.1145/2858036.2858245 download PDF talk at CHI'16 official project page https://robertkovax.com/patching-physical-objects Thu, 06 Oct 2016 15:59:25 +0000 dr robert kovacs https://robertkovax.com/patching-physical-objects Patching Physical Objects Alexander Teibrich, Stefanie Mueller, François Guimbretière, Robert Kovacs, Stefan Neubert, and Patrick Baudisch In Proceedings of the 28th Annual ACM Symposium on User Interface Software &amp; Technology (UIST'15) full paper: ACM digital library, PDF Personal fabrication is currently a one-way process: once an object has been fabricated with a 3D printer, it cannot be changed anymore. Any change requires printing a new version from scratch. The problem is that this approach ignores the nature of design iteration, i.e. that in subsequent iterations large parts of an object stay the same and only small parts change. This makes fabricating from scratch feel unnecessary and wasteful. <img width="1284" height="963" width_o="1284" height_o="963" data-src="https://freight.cargo.site/t/original/i/cfd90eb1c25d2d69bf16af501d20e344e970ec79d4ce48d4720d0118a7def16a/patching.PNG" data-mid="29969857" border="0" src="https://freight.cargo.site/w/1000/i/cfd90eb1c25d2d69bf16af501d20e344e970ec79d4ce48d4720d0118a7def16a/patching.PNG" /> In this paper, we propose a different approach: instead of re-printing the entire object from scratch, we suggest patching the existing object to reflect the next design iteration. We built a system on top of a 3D printer that accomplishes this: Users mount the existing object into the 3D printer, then load both the original and the modified 3D model into our software, which in turn calculates how to patch the object. After identifying which parts to remove and what to add, our system locates the existing object in the printer using the system’s built-in 3D scanner. After calibrating the orientation, a mill first removes the outdated geometry, then a print head prints the new geometry in place. Since only a fraction of the entire object is refabricated, our approach reduces material consumption and plastic waste (for our example objects by 82% and 93% respectively). A collaboration between Hasso Plattner Institute and Cornell University. <img width="82" height="80" width_o="82" height_o="80" data-src="https://freight.cargo.site/t/original/i/cac47e58ebabf7f08edeab6640c2892931d1a730f4e833f910e3486b84ccfafb/cornell.png" data-mid="29969855" border="0" src="https://freight.cargo.site/w/82/i/cac47e58ebabf7f08edeab6640c2892931d1a730f4e833f910e3486b84ccfafb/cornell.png" /><img width="72" height="72" width_o="72" height_o="72" data-src="https://freight.cargo.site/t/original/i/4758d4c7937998ad16abe9208d8cd6f0eb4cd8db392347ce6e099f8b65c2b711/hpi.jpg" data-mid="29969856" border="0" src="https://freight.cargo.site/w/72/i/4758d4c7937998ad16abe9208d8cd6f0eb4cd8db392347ce6e099f8b65c2b711/hpi.jpg" /> ACM publication: Alexander Teibrich, Stefanie Mueller, François Guimbretière, Robert Kovacs, Stefan Neubert, and Patrick Baudisch. 2015. Patching Physical Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software &amp; Technology (UIST '15). ACM, New York, NY, USA, 83-91. DOI: https://dx.doi.org/10.1145/2807442.2807467