Santa Fe Complex Awarded NSF Grant

The Santa Fe Complex is part of the New Mexico brain trust,” along with the University of New Mexico and the Institute of American Indian Arts, awarded $597,220 in funding from the National Science Foundations Partnership for Innovation program.

The grant will fund the development of the hardware and software that make it possible to use fulldome immersive environmentssuch as the LodeStar planetarium at the New Mexico Museum of Natural History and Scienceto help people visualize, simulate, or experientially comprehend a wide range of information.

The technology used in producing such immersive environments has a wide range of application, from educational and artistic material to evaluating scientific data and complex systems.

The Partnership for Innovation (PFI) grants promote innovation by bringing together colleges and universities, state and local governments, private-sector firms, and nonprofit organizations. PFI helps these organizations form partnerships that support innovation in their communities by developing the people, tools, and infrastructure needed to put new scientific discoveries to practical uses.

The team from UNM, led by Pradeep Sen, Assistant Professor in the Electrical & Computer Engineering Department, will focus on the technical aspects of the project and will work closely with researchers at the Santa Fe Complex, particularly Stephen Guerin and Steve Smith, to contribute to innovations in immersive technologies.

The Advanced Graphics Lab is the research laboratory at UNM that focuses on cutting-edge work in the technical aspects of computer graphics and digital media. The video-game development program that Sen started through AGL is ranked by Princeton Review as one of the top 50 video-game development programs in the country.

The Santa Fe Complex provides a collaborative workspace that fosters applied complexity science through interdisciplinary education, outreach, and development of innovative technologies to address real-world problems, enable social cooperation, and create economic opportunities.

SFComplex is an open community project incubator applying complexity research in the intersection of science, technology and art, said Stephen Guerin, who serves on the Complexs board of directors and is president of the Santa Fe-based Redfish Group. Were excited to work with our colleagues at UNM and IAIA to explore new applications in interactive dome projection and ambient computing that will help realize AnySurface applications where whole rooms become interactive.

The project team aims to innovate and develop fulldome projection technology scaled and priced in a way that makes it accessible to everyday users. The new technology is expected to drive innovation and foster growth of the digital media industry in New Mexico, including the states burgeoning film industry.

Making Immersion Possible

Domes are naturally an immersive medium, Sen said. Your entire field of view is covered by the computer-generated imagery. We propose to explore new ways to produce dome content efficiently as well as study how a team would use the dome to interact collaboratively with data.

Part of the Fulldome and Immersive Technology project will focus on developing novel technologies that make immersive environments possible without having to construct dome structures. The researchers believe that this will not only make immersive environments helpful in understanding complex scientific data, but will also lead to more commercialization opportunities for the technology.

Not everyone has a fulldome at home, Sen said. The way to make these technologies more accessible is to develop ways to turn any ordinary environment, say the corner of a room, into an immersive projection environment. Once everyone can get an immersive environment in their home, immersive content will naturally follow.

The project rests partly on the foundation already laid down by the ARTS Lab in putting together fulldome environments both at the LodeStar digital planetarium in the Natural History museum and at the ARTS Lab itself.

UNM had a previous PFI grant, The Digital Pueblo Project, for which Ed Angel, now chair of the board of directors at the Santa Fe Complex,  served as principal investigator. The project initiated efforts to build upon the scientific, artistic and cultural resources of New Mexico to create a sustainable distributed media industry. This project was the beginning of the collaboration on expanding fulldome technology under leadership of David Beining, who was then director of the LodeStar Astronomy Center.

The Digital Pueblo project was a major factor in establishing the ARTS Lab, with seed funding from the Governors Media Education Fund, and it led to collaboration with the Santa Fe Complex, which was seeded by the City of Santa Fe, and with IAIA and its New Media program.

These immersive environments create powerful science communications for both public education and scientific research, said Beining. In the Fulldome and Immersive Technology project, we intend to create both tools and professionals that can evolve into economically beneficial businesses as well as educationally supportive programs.

Research at the Santa Fe Complex will be centered on extending dome technology to ambient computing, an environment that includes projections on arbitrary surfaces such as the interior of rooms. Multiple cameras and projectors would allow the environment to react to users without the aid of devices such as computer mice or headsets.

Sen plans to start the AGLs portion of the work by creating a flexible software framework that will help programmers develop dome and immersive software. The framework will act as a middle layer between the developers application and the display software to give the programmer flexibility in creating new uses for immersive environments.

In traditional computers, developers use platforms such as OpenGL or DirectX to decouple their code from the display, Sen said. We need to do something similar for projection domes, where the software infrastructure will automatically adjust based on the configuration of the environment.

Expanding Workforce Skills

The project will help develop an educated workforce for a new high-tech industry in New Mexico, and both UNM and the Institute of American Indian Arts will have a key role in this area.

UNM classes taught through the ARTS Lab will use dome technologies for student projects. In Santa Fe, students at IAIA will gain hands-on experience by working with a multi-surface immersive environment that will be set up on their campus using UNM fulldome expertise and funds from the PFI grant.

With the new dome facility at the Institute of American Indian Arts, said IAIA Academic Dean Ann Filemyr, we are hoping to extend our reach in serving Native communities with cutting-edge technology for educational purposes ranging from indigenous astronomy to new ways to share traditional stories.

IAIAs mission is to empower creativity and leadership in Native arts and cultures through higher education, lifelong learning and outreach. The IAIA installation will also broaden the range of spaces in which fulldome technology is currently being applied. In this case, the uses of the fulldome will include educating students in STEM-related areas: science, technology, engineering and math.

The Institute of American Indian Arts, through its New Media Arts Department, is taking bold steps to ensure that our students have access to leading technologies in order to empower themselves as future storytellers, said IAIA New Media Arts Chair Carlos Peinado. Our partnership with the University of New Mexico, the Santa Fe Complex and other PFI stakeholders will allow our students access to project-based materials that will investigate the creation and application of immersive media, a subject that holds interesting possibilities for a myriad of challenges facing Indian Country.

This PFI grant recognizes New Mexicos unique technological, cultural and artistic resources, said consortium co-leader Ed Angel. It also recognizes New Mexicos leadership in an area of enormous potential for a sustainable industry, and the commitment of multiple institutions and government to the success of the project.