John Filliwalk

Led by Associate Professor John Fillwalk, Ball State’s IDIA Lab pioneers immersive technologies, supporting education and global projects, with a new Center for Innovation set to expand its community engagement

Eighteen years ago, a vision took root at Ball State University—a vision to bridge the gap between emerging digital technologies and immersive learning experiences. This vision led to the establishment of the Institute for Digital Intermedia Arts (IDIA), an interdisciplinary lab that has since become a pioneer in augmented reality (AR), virtual reality (VR), 3D modeling, and digital humanities.

With generous initial support from two Lilly Endowment, Inc.- Digital Media Initiative grants totaling $40 million, the IDIA Lab emerged as one of four specialized institutes tasked with pushing the boundaries of digital innovation at Ball State.

Today, two of those four original centers remain, and both are thriving—the IDIA Lab and Digital Corps. The latter is a team of undergraduate students who support academic success at the University by providing various services, including video production, design, and user experience design.

The IDIA Lab is run by Associate Professor John Fillwalk, senior director, and his team of artists, designers, 3D modelers, animators, programmers, and drone pilots. Under Prof. Fillwalk’s leadership since the lab’s inception, this dedicated staff has shaped it into the innovative powerhouse it is today.

“I had been working in virtual reality for quite a while and other interactive digital media art forms,” said Prof. Fillwalk. “So, we positioned the lab to support research and experience development—especially emergent 3D design platforms. We focused on creating and carving out a unique brand and point of distinction for the University. At the time, this was very niche and forward-looking and provided the opportunity for the University to be unique in that space.”

A Vision Supported

Marius Igitangaza Ngabo, right, a graduate student in landscape architecture, is gaining valuable hands-on experience working as a graduate assistant in the IDIA Lab.

Marius Igitangaza Ngabo, right, a graduate student in landscape architecture, is gaining valuable hands-on experience working as a graduate assistant in the IDIA Lab.

Phil Repp, former dean of the Estopinal College of Architecture and Planning (ECAP) and former vice president for information technology, co-wrote the Lilly Endowment, Inc.- Digital Media Initiative Grants proposal with Dave Ferguson, ’78, current dean of ECAP. Their work was pivotal in securing the funding and fostering the lab’s early vision. The IDIA Lab was created to support faculty and student projects while fostering external partnerships to fund the innovative work it envisioned.

“One of the advantages of Ball State’s culture of applied research and technology is that initiatives like IDIA Lab are strongly oriented toward collaboration with external groups and clients,” Dean Ferguson said. “These partnerships with IDIA Lab lead to wonderful projects that help communities, corporations, and non-profits advance their aspirations for augmented and virtual reality experiences for their audiences and stakeholders.”

While the Lilly Endowment grants provided an essential foundation, sustaining the lab required additional funding. Prof. Fillwalk often turned to external contracts to support its operations.

“John linked to pedagogy and helped the nursing field with those simulations,” Mr. Repp said. “But then he began looking at the visualization of historic sites, which is a unique vertical. He developed contacts and got a reputation around the country, if not the world, on the institute’s ability to represent and visualize pieces or places that no longer exist.”

Mr. Repp, who recently retired from Ball State before joining Western Michigan University as its director of the WMU Richmond Institute for Design and Innovation, praised Prof. Fillwalk and his work.

“I spent 37 years at Ball State in a variety of roles, from a young assistant professor all the way to as vice president and dean,” Mr. Repp said. “In all of those things, I am most proud of the Digital Corps and the Institute for Digital Intermedia Arts. When I think of my career, I am so proud to be a part of those efforts.”

A Legacy of Impactful Projects History Channel at IDIA Lab (ECAP) on Apr. 9, 2024

Neil Zehr, the IDIA Lab’s virtual and hybrid worlds production specialist, has been on the team for 16 years. He started as a 3D modeler and animator but has expanded his knowledge base over the years. He spends much of his time, along with other lab staff, developing interactive apps for clients. The team includes Adam Kobitz, ’12 MFA ’18, Trevor Danehy, ’07, and Michael Rhoades. Their work involves creating visuals based on provided reference materials, designing realistic lighting, and developing interactivity. They also create custom scripts for characters as they move through the app, publish the content, and troubleshoot errors in the environment for museums and other universities. He’s worked on many projects during his time at the lab, but he referenced his favorite as a simulation of the 1915 World’s Fair in San Francisco.

Prof. Fillwalk and his team in the IDIA Lab worked for several months to digitally reconstruct Pumapunku using advanced 3D modeling and simulation techniques. This project was not merely a visual recreation but an attempt to understand the cultural, architectural, and environmental context of the ancient city.

Prof. Fillwalk and his team in the IDIA Lab worked for several months to digitally reconstruct Pumapunku using advanced 3D modeling and simulation techniques. This project was not merely a visual recreation but an attempt to understand the cultural, architectural, and environmental context of the ancient city.

“Two sculptures from the fair were located at Ball State’s art museum,” Mr. Zehr said. “A group of Ball State students and IDIA Lab staff used a laser scanner to create accurate 3D models of the sculptures. Then, we virtually recreated a large portion of the World’s Fair based on fairly extensive photography of the event so that the sculptures could be placed back into their original context. Most of the fair’s structures were demolished after the event ended in 1915, so it felt like we were bringing the experience back to life for a new generation to enjoy.”

One of the more recent projects involves the reconstruction of Pumapunku, an ancient archaeological site in the Bolivian highlands near Lake Titicaca, famous for its mysterious and intricate stonework. The team used 3D modeling and data from NASA to create a virtual replica of the site, which was featured on the History Channel in Fall 2024. This recreation showcased the remarkable achievements of the ancient people who built it.

“It’s probably one of the most challenging projects that we’ve ever tried to reconstruct because the site itself was incomplete—abandoned before totally constructed,” Prof. Fillwalk said. “We tried to imagine the original architects’ vision.”

This project was not merely a visual recreation but an attempt to understand the ancient city’s cultural, architectural, and environmental context. By doing so, his team hopes to provide deeper insights into the construction methods used by the ancient civilization and the site’s possible significance in pre-Columbian history.

Prof. Fillwalk and his team have also been showcased on the History Channel in previous episodes of its series The Universe for their efforts in recreating ancient Roman structures and the famous wonder of Stonehenge. The precision involved in these projects was immense, down to accurately simulating the sun and moon’s positioning thousands of years ago, bringing the past to life.

Adam Kobitz, ’12 MFA ’18, operates a drone to capture multiple images that can be overlapped to create a 3D rendering of Beneficence in a process called photogrammetry.

Adam Kobitz, ’12 MFA ’18, operates a drone to capture multiple images that can be overlapped to create a 3D rendering of Beneficence in a process called photogrammetry.

Collaborating on a Global Scale

Along with the History Channel, IDIA Lab’s reputation has attracted partnerships with other prestigious institutions, such as NASA. The list of co-collaborators is extensive, including Seattle Children’s Hospital, Indiana University School of Medicine, UCLA, University of Huddersfield in the UK, Eli and Edythe Broad Art Museum at Michigan State University, Technische Universität Dortmund in Germany, and Trinity College in Ireland. These partnerships enabled the lab to work on ambitious projects that extend beyond academia.

One such partnership involved the Smithsonian Institute, where the lab helped develop Virtual Milestones of Flight, an immersive head-mounted display prototype designed for the permanent exhibition at the Smithsonian Air and Space Museum in Washington, D.C.

The exhibition and simulation highlight some of history’s most significant airplanes, rockets, and spacecraft. Notable aircraft featured in the simulation include Charles Lindbergh’s Spirit of St. Louis, the X-15—a hypersonic rocket-powered aircraft used by the U.S. Air Force—the Wright Brothers’ Flyer, Sputnik (the first Russian artificial satellite), and NASA’s Apollo 11 Lunar Lander.

Prof. Fillwalk and his team also work in healthcare, partnering with the Indiana University School of Medicine to create innovative training tools for future physicians and medical professionals.

“Since around 2018, we’ve been developing much more with AI,” said Prof. Fillwalk. “We created a virtual patient for students who are learning to communicate and determine diagnoses. We give her (the simulated patient) a patient history. Students talk to her, and she talks back with her voice. Instead of being scripted with the same kind of response you get through traditional simulation, they get a dynamic conversation close to what you’d get if it were real life.”

Internal Collaboration

While its external projects often receive international attention, the IDIA Lab remains deeply committed to supporting Ball State’s faculty and students. The lab collaborates with various colleges and departments across campus, from creating virtual simulations for the College of Health to developing interactive experiences for the Department of Criminal Justice and Criminology by creating a virtual courtroom enabling students to engage in courtroom simulations using avatars. This approach helped facilitate knowledge and empathy while allowing students to practice their decision-making skills in a courtroom environment.

Another notable initiative is Deep Mapping Middletown, which transforms the rich archive of the Middletown Studies project into an interactive digital experience. By integrating Geographic Information System (GIS) data with virtual reality, the project enables users to explore Muncie’s history, shedding light on social and racial dynamics over time.

This initiative exemplifies the IDIA Lab’s mission: transforming complex data into accessible, engaging experiences that foster deeper understanding.

“In projects like these, we position ourselves as a resource for the University,” Prof. Fillwalk explained. “Whether helping faculty with research or providing students with opportunities to work with cutting-edge technologies, our goal is to contribute to the academic community and engage in innovative solutions for learning and discovery.”

A New Center for Innovation

Looking ahead, the IDIA Lab is poised to expand its impact and serve Ball State on a broader scale through its inclusion in the now-under-construction Center for Innovation. Designed to foster collaboration between the University, industry, and the community, this new hub will emphasize public-facing projects, industry partnerships, and community engagement.

Located at the southeast corner of Ashland Avenue and Martin Street, the three-story, 30,000-square-foot facility will be a cornerstone of Ball State’s broader Village revitalization plan. Set to open in Summer 2026, the center will house the IDIA Lab as one of its initial collaborators, providing new opportunities to amplify its innovative work.

“The new center will expand our mission as one of the intentions is to create a strong point between the community and the University,” Prof. Fillwalk said. “We will expand direct outreach from the University but will also offer industry-partnered initiatives such as internships, training, and workshops. Historically, we’ve been developing national and international research and contracts with blended internal projects, but this will be a focused internal energy. I think it’ll allow us to shift and expand services.”

Dr. Jennifer Palilonis, ’96 MA ’04, George and Frances Ball Distinguished Professor of Multimedia Storytelling, will serve as the center’s interim director. She envisions the Center for Innovation as a catalyst for meaningful partnerships and creative solutions that address community needs.

“The Center for Innovation will be a hub for collaboration and creativity that brings together our campus expertise and resources with community partners, organizations, and businesses,” Dr. Palilonis said. “We will provide programming to advance local and state economies, talent pool, and communities. The center will excel at outreach and community engagement and support, applied (practical) research, and providing relevant career-oriented education.”

Prof. Fillwalk sees this as a natural progression for the IDIA Lab.

“We’ve always been about innovation, but now we want to take that to the next level,” he said. “The new center will allow us to share our work more broadly and explore new applications for immersive technologies.”