phdstudent

Bruns & Leslie research cybernetic human advancement with New Frontiers Grant

Michael Kwolek — Tue, 17 Jun 2025 21:31:49 +0000

Bruns & Leslie research cybernetic human advancement with New Frontiers Grant Michael Kwolek Tue, 06/17/2025 - 15:31

Michael Kwolek

From implantable devices like pacemakers and brain interfaces to smart wearables, humans are fast becoming more cybernetic than we might realize.

Implanted devices tend to have higher fidelity and functionality than wearables, but require extremely invasive surgery. Smart tech is lower-cost and easy to use, but can be uncomfortable while offering limited functionality.

What if there was a middle ground, a set of technologies that allowed for the best of both worlds? Such solutions could enable people to achieve peak performance in a range of physical and mental activities, simplify ongoing health monitoring, and help those with mobility challenges control the devices that support their daily lives.

Seamless Skin Integration of Brain/Body-Computer Interfaces for Cybernetic Human Advancement

Project: Seamless Skin Integration of Brain/Body-Computer Interfaces for Cybernetic Human Advancement

Planning Phase Award: $50,000

The è�� New Frontiers Grant Program is designed to foster groundbreaking, interdisciplinary research projects with the potential for high impact. “High impact” projects may include the potential for significant advancements in knowledge, problem-solving or innovation that exceeds incremental progress and creates new paradigms of understanding.

With support from the Research & Innovation Office (RIO), the Colleges of Arts & Sciences, Engineering & Applied Science and the School of Education, New Frontiers is open to any eligible è�� faculty member.

A surprising partnership

Researchers at the ATLAS Institute are working on just that through a unique collaboration toward what they call “cybernetic human advancement.”

Carson Bruns, associate professor (ATLAS Institute, Mechanical Engineering), and Grace Leslie, associate professor (ATLAS Institute, College of Music), have partnered to study ways to create the functionality of an implantable device with the ease of a wearable.

The project was kickstarted with funding from è��’s New Frontiers Grant Program.

This 12-month Planning Phase Award, funded through the Research & Innovation Office (RIO), supports project planning and initial data collection for two lines of inquiry.

Real life sci-fi

Cybernetic humans may sound like science fiction, but such technology is very much a reality. Bruns explains, “When we hear the word ‘cyborg,’ we think of a cyberpunk half-robot. But there are really common examples of body-integrated technology like cochlear implants for the hearing impaired or lens replacements for vision-impaired people or cardiac pacemakers for people who have heart conditions.”

He elaborates, “We're going to continue to integrate our bodies with technology more and more. And we'd like to contribute our own piece to this movement to ensure that it's done in a safe and ethical way, and also because we think it's exciting and there are tremendous potential benefits. So we decided to call this domain ‘human enhancement’ as opposed to ‘cyborg’ or ‘cybernetic.’”

The skin as interface

It’s possible the next generation of wearables will not look like the watches and rings we currently see in the market.

Bruns says, “One of the things I do in my lab is try to use the skin as the interface for these human enhancements. These technologies that we're going to merge with the body, I think the skin is really the best for that because it's the least invasive place to put a permanent implant. You usually don't even need a doctor or a hospital if it's small enough. You can just tattoo it, and that's something that almost anybody can do safely. So it's very convenient if you're going to permanently implant some technology in your body to make it be a tattoo.”

For example, you wouldn’t want to wear an EKG monitoring cap on your head all day, but if you could get tattooed with conductive materials that connect to a simple device, that could allow for continuous brainwave monitoring without ongoing discomfort.

Seeking key collaborators

The core team seeks a few more key members during this initial research phase. Carson details what expertise they seek:

Ethicist: “There are a lot of serious ethical questions about these types of technologies. We are actively looking for somebody to be a part of this and inform our team and do their own research on the ethics of this space.”

Circuits expert: “We would [also] like a circuits expert. They might be an electrical engineer—somebody who really knows how to optimize this kind of hardware. I have the expertise to make a special kind of conductive material to build the device and once you have the signals, Grace is really good at doing stuff with those. But in between those two, we need that person who can take the material and construct the exact circuit we want to get the best signal.”

Performance enhancing tattoos

Leslie is excited about the possibility of applying her expertise in neuroscience to studying wearables to enhance athletic performance. “We want to work with the CU football team to develop this augmented football player concept using control theory to figure out what the best type of feedback would be to get them in the right state. The really quick decision making they have to do for who to pass to and when, and the movements that they take, will all be optimized.”

In lieu of starting right away with permanent tattooing, the team aims to design with an even more common application in mind.

Leslie continues, “We're thinking of this being almost like a temporary tattoo. Printing a whole circuit board onto that sticker and then any components that we need to add. So it becomes this all-in-one [device] on the surface of the skin. It would be a combination of, on Carson's side, the ability to think of a completely different form factor for a circuit that involves the skin—it isn't just some standalone device that we then try to attach to the human. And then from my lab’s side, the idea of how you can provide meaningful stimulus and feedback in a way that doesn't require a screen.”

Getting into the flow

Leslie hopes to apply her background in music and audio to create novel sensory stimuli like sounds and haptic feedback (little vibrations similar to what is used in a mobile phone) in place of a screen to help guide people toward achieving a “flow state” of peak performance in a range of activities.

Leslie says, “Haptic feedback is the educational tool that helps you learn what that feels like to be in that state. The principle of biofeedback [is] that eventually if you've practiced it enough, you can reach it without the feedback and then it creates lasting changes.”

Big ideas from new connections

The initial idea for this project started when ATLAS PhD students Joshua Coffie (in the Emergent Nanomaterials Lab) and Daniel Llamas Maldonado (in the Brain Music Lab) found mutual interest in their respective research areas. Llamas Maldonado explains, “We were in the Research Methods class together, and I thought his research was really cool. We just started talking and thinking we could do something together.”

This spark speaks to the importance of fostering opportunities for cross-pollination on campus that can be supported by RIO grants.

From there, the conversation expanded to Leslie and Bruns, who catalyzed the idea by applying for the New Frontiers Grant program. This spark speaks to the importance of fostering opportunities for cross-pollination on campus that can be supported by RIO grants.

With concurrent lines of research, the key will be to focus the research in this initial phase. Leslie concludes, “It's easy to think of science fiction scenarios, but the hard part is coming up with concrete experiments to run that will be really self-contained and controlled, and that are going to prove the things that we need to prove to build the larger concept. And that is also the fun part.”

Nanomaterials and neuroscience researchers aim to build brain/body interfaces that enhance performance, improve health monitoring and support mobility.

Off

Traditional

White

Image source: Adobe stock

Colorado-based Computer Graphics Professionals Make Their Mark at SIGGRAPH 2024

Anonymous — Fri, 02 Aug 2024 16:30:29 +0000

Colorado-based Computer Graphics Professionals Make Their Mark at SIGGRAPH 2024 Anonymous (not verified) Fri, 08/02/2024 - 10:30

ATLAS community members, including professor Ellen Do and PhD student Ruhan Yang, presented at this year's conference in Denver.

Off

Traditional

White

ATLAS PhD student deploys papercraft to make engineering tangible and fun

Anonymous — Tue, 30 Jul 2024 19:50:41 +0000

ATLAS PhD student deploys papercraft to make engineering tangible and fun Anonymous (not verified) Tue, 07/30/2024 - 13:50

ATLAS PhD student Ruhan Yang blends papercraft and circuit design to make engineering more tangible, accessible and fun for tinkerers of all ages.

Off

Traditional

White

Public-private partnership drives attention for ATLAS research in augmented and mixed reality

Anonymous — Thu, 18 Jul 2024 16:41:59 +0000

Public-private partnership drives attention for ATLAS research in augmented and mixed reality Anonymous (not verified) Thu, 07/18/2024 - 10:41

Michael Kwolek

Partnerships between universities and industry can yield important research and commercial breakthroughs. ATLAS professor Ellen Do has worked to cultivate relationships between è�� and industry players, including as a member of the Pervasive Personalized Intelligence (PPI) Center, to support graduate students and enhance opportunities for commercialization of ATLAS research.

The PPI Center, which recently concluded its tenure, was founded “with a mission of bringing industry and university talent together to solve the intelligence challenges faced by software and computer engineers in Internet of Things systems." It operated under the supervision of the National Science Foundation and included members from NEC, Intel and Trimble.

“It’s been such a good experience. We’ve learned a lot. Ellen Do and her team have helped to expand our thinking and encouraged us to explore new areas.” - Dr. Haifeng Chen, Head of Data Science Department at NEC Laboratories, and his colleague Kai Ishikawa, Principal Researcher (PPI Center event recap)

The PPI Center’s Spring 2024 Industry Advisory Board Meeting in Portland, OR, included a research poster session, and ATLAS students were honored with three of the four awards industry attendees voted on at the event.

Suibi Che-Chuan Weng, PhD student, won "Most Industry Ready" for Editing Reality: Empowering Users to Manipulate Reality through Addition, Erasing, and Modification with Speech to Prompt in Mixed Reality.
Rishi Vanukuru, PhD student, won "Most Impactful" for Asynchronous spatial guidance using mobile devices and Augmented Reality.
Ada Zhao, MS student, won "Most Impactful" for The WizARd and Apprentice: Augmented Reality Expert Capture for Training Novices.

2 more ATLAS PhD students participated: Krithik Ranjan presented PuppetGuide: Tangible Personalized Museum Tour Guides using LLMs and David Hunter presented Tangible Interaction with Object Detection and Large Language Models.

As for the experience participating in the PPI Center, Do says, “it is good to know that the industry is interested in supporting research and considers our research relevant.” She sees ways ATLAS could form partnerships within several industry sectors on a range of themes due to the multidisciplinary nature of the research conducted here.

Since their involvement in PPI started, Do and her team have had a series of meetings with mentors from global technology firms, discussing collaborative research opportunities.

Vanukuru is currently doing an internship at Microsoft Research Cambridge focused on spatial computing in its VR/AR group. Weng and Zhao are working on research in the ACME Lab this summer, extending the Editing Reality (and PuppetGuide), and WizARd and Apprentice projects with interns from the CU SPUR program. Zhao is also conducting a pilot study, interviewing laser cutter operating experts about how they would demonstrate operations and how they can annotate their demonstration using the WizARd prototype for novice learners. Hunter has embarked on an internship with Trimble this summer, while he and Ranjan are also working in the ACME Lab.

ACME Lab members built relationships with industry players through the Pervasive Personalized Intelligence (PPI) Center by collaborating on solutions to challenges in building Internet of Things systems. Three ATLAS PhD students took home awards from the PPI Center's Spring 2024 Advisory Board Meeting.

Off

Traditional

White

Ruhan Yang passes preliminary exam

Anonymous — Tue, 23 Aug 2022 21:42:11 +0000

Ruhan Yang passes preliminary exam Anonymous (not verified) Tue, 08/23/2022 - 15:42

ATLAS PhD Student Ruhan Yang passed her preliminary exam on August 4. Her work on her dissertation, "Paper Robot Building Kits: Present and Future," is overseen by Professor Ellen Do, Professor Mark Gross and Assistant Professor Daniel Leithinger.

Yang is a PhD student in Creative Technology and Design, advised by Ellen Do, director of the ACME Lab. Yang's research focuses on paper interaction and toy design. She enjoys crafting and wants to share the pleasure of it with more people.

Yang has been working on designing educational toys and tools for many years, and she is the co-founder of EdBoard Technologies, an award-winning startup education technology company. She hopes to bring opportunities to more children through her designs.

Yang earned a Master of Science in Creative Technology and Design and a Bachelor of Science in mechanical engineering, both from è��.

Off

Traditional

White

Kailey Shara passes comprehensive exam

Anonymous — Tue, 23 Aug 2022 20:46:56 +0000

Kailey Shara passes comprehensive exam Anonymous (not verified) Tue, 08/23/2022 - 14:46

ATLAS Institute PhD candidate Kailey Shara passed her comprehensive exam on August 8. Her work on her dissertation, "Designing New Hardware for Chemical Automation," is overseen by committee members Assistant Professor Carson J. Bruns, Professor Mark Gross, Daniel Szafir, assistant professor of computer science at University of North Carolina at Chapel Hill, Associate Professor Gregory Whiting and Professor Eric Bogatin.

ABSTRACT: This comprehensive exam proposal outlines our recent work to build new automation hardware for synthetic chemistry labs. Synthetic chemistry drives innovation in countless domains, ranging from life-saving pharmaceuticals to advanced materials for energy harvesting and space exploration. Accelerating the pace of organic synthesis has thus far been challenging to achieve through automation, but this goal is highly anticipated since organic synthesis is often the main R&D bottleneck for many projects. The proposal covers ongoing work in the design and construction of an all-in-one robotic platform for automated chemical synthesis. The goal is to reach a working prototype of a robot that can automatically complete an entire chemical synthesis.

Originally from Montreal, Canada, Shara studied both chemistry and electrical engineering at Case Western Reserve University before joining the ATLAS Institute in 2018 to pursue her PhD. Advised by Carson Bruns, director of the Laboratory for Emergent Nanomaterials, her research focus includes the synthesis of artificial molecular machines, as well as engineering systems for laboratory automation. Her startup company, Chembotix, has won numerous awards including first place in the 2022 New Venture Challenge (NVC) championship.

Off

Traditional

White

Peter Gyory passes comprehensive exam

Anonymous — Tue, 23 Aug 2022 17:15:11 +0000

Peter Gyory passes comprehensive exam Anonymous (not verified) Tue, 08/23/2022 - 11:15

ATLAS Institute PhD candidate Peter Gyory passed his comprehensive exam on August 18. His work on his dissertation, “Developing Tools to Support Approachable Game Controller Design,” is overseen by committee members, Professor Ellen Do, Associate Professor Amy Banic, Associate Professor Joel Swanson, Michael Rivera, Associate Professor Patrick LeMieux (UC Davis) and Professor Mark Gross.

During his exam, Gyory outlined his work in game controller design. His research goal is to expand tangible user interface research by exploring the design space of alternative controller (Alt Ctrl) games. In addition, Gyory wants to develop tools that make the creation of Alt Ctrl games more approachable for those without much physical computing experience. During his exam, Gyory showcased his projects, HOT SWAP and Tinycade, game controller platforms that can be reconfigured to support multiple games. He also outlined his planned work in developing an Alt Ctrl toolkit called "Beholder Observables," a platform implemented with computer vision that requires only a smartphone to use it.

"I hope my work will make physical computing more approachable to those without advanced fabrication tools," Gyory says.

Prior to working on his PhD, Gyory received a BS in Game Design and Development from the Rochester Institute of Technology in 2016 and an MS in Creative Technology and Design from the ATLAS Institute.

More information

Draft Comprehensive Exam

Off

Traditional

White

How to turn throwaway cardboard into a DIY arcade game

Anonymous — Fri, 22 Jul 2022 16:30:31 +0000

How to turn throwaway cardboard into a DIY arcade game Anonymous (not verified) Fri, 07/22/2022 - 10:30

Like many people across Colorado, Peter Gyory spent the height of the COVID-19 pandemic sitting at home with nothing to do. Then the ATLAS-based PhD candidate and game designer looked around his apartment: “I was surrounded by cardboard. I thought: ‘How could I make a game out of that?’”

Off

Traditional

White

ATLAS research front and center at DIS’22

Anonymous — Wed, 29 Jun 2022 19:26:58 +0000

ATLAS research front and center at DIS’22 Anonymous (not verified) Wed, 06/29/2022 - 13:26

Researchers from ATLAS Institute's Unstable Design, THING, Living Matter and Superhuman Computing labs presented four papers, including three that received “Honorable Mention” awards, at the ACM conference on Designing Interactive Systems (DIS '22).

Off

Traditional

White

DIS'22: Exploring how designers approach emotional robotic touch

Anonymous — Wed, 22 Jun 2022 10:54:16 +0000

DIS'22: Exploring how designers approach emotional robotic touch Anonymous (not verified) Wed, 06/22/2022 - 04:54

THING Lab

“EmotiTactor: Exploring How Designers Approach Emotional Robotic Touch,” authored by Ran Zhou, Harpreet Sareen, Yufei Zhang and Assistant Professor Daniel Leithinger, director of the THING Lab, won a Best Pictorial Honorable Mention award at the ACM SIGCHI Conference on Designing Interactive Systems (DIS '22). Zhou, an ATLAS PhD student who was also the publication co-chair for DIS'22, presented the research during the Multisensory Design session.

Prior psychology findings show humans can communicate distinct emotions solely through touch, and in this work, THING Lab researchers hypothesize that similar effects might also be applicable to robotic touch. Their findings uncover that the "otherness" of robotic touch broadens the design possibilities of emotional communication beyond mimicking interpersonal touch. Bringing designers into the exploration of emotional robotic touch, the researchers discuss their design decisions and reflect on their insights. To enable designers to easily generate and modify various types of affective touch for conveying emotions (e.g., anger, happiness, etc.), the researchers also developed a platform consisting of a robotic tactor interface and a software design tool. When conducting an elicitation study with 11 interaction designers, they discovered common patterns in their generated tactile sensations for each emotion.The researchers also illustrated the strategies, metaphors, and reactions that the designers deployed in the design process.

Publication

Ran Zhou, Harpreet Sareen, Yufei Zhang, and Daniel Leithinger. 2022. EmotiTactor: Exploring How Designers Approach Emotional Robotic Touch. In Designing Interactive Systems Conference (DIS '22). Association for Computing Machinery, New York, NY, USA, 1330–1344. https://doi.org/10.1145/3532106.3533487 .pdf (June 13-17, 2022—Virtual Event, Australia) [Best Pictorial Honorable Mention].

Prior psychology findings show humans can communicate distinct emotions solely through touch. In this award-winning work presented at DIS'22, THING Lab researchers hypothesize that similar effects might also be apply to robotic touch.

Off

Traditional

White