Thanks for your patience during our recent outage at scalar.usc.edu. While Scalar content is loading normally now, saving is still slow, and Scalar's 'additional metadata' features have been disabled, which may interfere with features like timelines and maps that depend on metadata. This also means that saving a page or media item will remove its additional metadata. If this occurs, you can use the 'All versions' link at the bottom of the page to restore the earlier version. We are continuing to troubleshoot, and will provide further updates as needed. Note that this only affects Scalar projects at scalar.usc.edu, and not those hosted elsewhere.
C2C Digital Magazine (Spring/Summer 2023)Main MenuLetter from the C2C Chair -- Cheryl ZelleThis is a letter from the 2022 - 2023 C2C Chair, Cheryl Zelle.The SHARE technique for designing assignments and assessments in the age of AIThis article is "The SHARE technique for designing assignments and assessments in the age of AI." This was written by Brent A. Anders.Changing our classrooms to address COVID-19’s impact on cognitionThis article is "Changing our classrooms to address COVID-19’s impact on cognition." This was written by Dr. Jessica A. Cannon.Learning by doing: The flight path of Dr. Sheldon L. Eakins, an intrepid equity entrepreneurThis article is "Learning by doing: The flight path of Dr. Sheldon L. Eakins, an intrepid equity entrepreneur."At the intersection of information science, learning technologies, and data science: A reflection of a three-article dissertation journeyThis article is "At the intersection of information science, learning technologies, and data science: A reflection of a three-article dissertation journey." This is by Dr. Javier Leung.A practical framework for ethics in educational technologyThis research article is "A practical framework for ethics in educational technology."“I have a need…the need for speed”: Why slowing down can benefit instructional designThis article is: “I have a need…the need for speed”: Why slowing down can benefit instructional designJosh Lake: The cheerleader and life coach every school needsThis article is "Josh Lake: The cheerleader and life coach every school needs." This is by Dr. Robb Scott.Animating and voicing digital puppets with Adobe Character AnimatorThis article is "Animating and voicing digital puppets with Adobe Character Animator."A starter conversation about “educational technologies” with Bard AI and ChatGPTThis article is "A starter conversation about “educational technologies” with Bard AI and ChatGPT."Credible efficient pathways to project completion with AON diagramsThis article is "Credible efficient pathways to project completion with AON diagrams."Book review: Shaping up online education post-pandemicThis article is "Book review: Shaping up online education post-pandemic ."Book review: Harnessing computation for more sustainable livingThis article is "Book review: Harnessing computation for more sustainable living."Book review: Improving human decision-making by reducing bias and noiseThis article is "Book review: Improving human decision-making by reducing bias and noise."Book review: Harnessing problem solving as a superpowerThis article is "Book review: Harnessing problem solving as a superpower."Book review: Volunteer technologists breaking ransomware by criminal gangsThis work is titled "Book review: Volunteer technologists breaking ransomware by criminal gangs."Book review: Helping advocacy citizen journalists upskillThis article is "Book review: Helping advocacy citizen journalists upskill."SIDLIT Awards: 2001 - PresentThis page shows "SIDLIT Awards: 2001 - Present."Call for Article Submissions: Fall 2023 - Winter 2024This page is "Call for Article Submissions: Fall 2023 - Winter 2024."Colleague 2 Colleague63e768dc8f8b0f24d3f519aec8f8ab91fe4a26a3
Using Aero to make mobile AR learning experiences
12023-06-15T06:38:50-07:00Shalin Hai-Jew0b2ab93fbfe95de74ca7fefa80ae22adae3a64ef414076This article is "Using Aero to make mobile AR learning experiences."plain2023-06-20T11:06:36-07:00Shalin Hai-Jew0b2ab93fbfe95de74ca7fefa80ae22adae3a64efBy Shalin Hai-Jew, Kansas State University
A popular catchphrase for the moment involves the “metaverse,” which is conceptualized in part as an overlay of digital elements over the physical world (with aspects of both visual simultaneously).
A small aspect of a “metaverse” may be built for mobile augmented reality (AR) learning, using a popular application that enables end-to-end development-to-deployment. Mobile AR refers to the use of a mobile device (think smartphone, an iPad, or other device that can run the Aero app) to experience the augmented reality without the need for a head-mounted displayed (HMD) or smart glasses. This app is Adobe Aero, which is a tool that may be activated as part of the Adobe Creative Cloud Suite.
AR is not just about digital visuals overlaid over physical space. Oftentimes, AR includes sound effects. It can include interactivity. AR is about embodied experiences and experiential learning. The capabilities of the technologies are advancing, with advances in wireless and cell connectivity enabling ever more enriched communications.
This short article introduces some basic features of Aero, which was released in November 2019.
To introduce the tool, a few short videos have been made to show some of the visual qualities of the digital characters and objects. These videos are made with pre-builts inside the Aero app. The objects are three-dimensional (x, y, and z axes), and they are built using sparse polygons (given the connectivity needs to show the animation).
For those who are familiar with Adobe Creative Cloud applications, Adobe Aero offers a clear basic interface, with a navigation bar at the top, a left toolbar, a Behavior Builder at the bottom left, a large workspace in the center, and a properties panel to the right. (Figure 1)
Figure 1: Adobe Aero Graphical User Interface (GUI)
As part of the app, users have access to Adobe Aero in the cloud, which hosts the respective published and unpublished Aero files. Each published file comes with a URL and a QR code, which spawns the AR experience. Aero files are .REAL file types. (Figure 2)
Figure 2: Adobe Aero in the Cloud
The Work Pipeline
In terms of a work pipeline, a designer/developer may conceptualize the teaching and learning experience that they want to deploy. They create the artworks, digital puppets, motions, animations, sound, and other elements in other software tools. Then, they import the digital objects into Aero, place them in 3d space, add animations, test, revise, and then deploy.
Aero takes still images [.png (raster), .svg (vector), .psd (Photoshop document, for editable layers to enable objects to be “set back” in visual space), .jpg / .jpeg (raster, lightweight, lossy/nonlossy),.tif / .tiff, .gif (animated .gif for animated sequences), and others. 3d objects may be imported as .obj (3d geometries), .glb (“3D scenes, models, lighting, materials, node hierarchy and animations”) (“What is a GLB file?..., Visao) / GL Transmission Format Binary (GLB) (standardized format), and .fbx (3d model file) (“Filmbox” format by Autodesk) (proprietary format). Animated characters may be exported as .glb or .fdx files, with animations already applied, animations imported separately, scripted animations to apply to existing characters in Aero, or animations to apply to character “skeletons”. Collision detection may be set to emulate in-world physics.
Various tools in the Adobe Creative Cloud suite—Illustrator, Photoshop, Dimensions—enable export to Aero, but many of the 3d visuals are actually 2d (flat plane) with the illusion of 3d. 3d objects may be created in Unity or other game engines and other software programs, with sparse polygons that may be used in Aero.
The AR experiences may be built on Aero running on a desktop machine and then displayed on an iPad, or they may be fully built and deployed and experienced on an iPad, at present.
AR for Teaching and Learning
The common “value-added” of AR for learning involves the ability to depict scenarios from the imagination, from extreme scales (nanoscale, galaxy scale), and the ability to simulate the world.
The mechanics of building an AR experience on Aero is straightforward, but structuring the AR experience for effective learning is more challenging. The visuals that may be used are limited, so they have to be purposefully selected. They have to be fairly accurately representational even in the absence of precise details. Interfaces of the AR have to be intuitive. The entire experience has to be accessible both virtually and physically. This means that information needs to be conveyed in multi-channel ways, and proper labeling is important.
It helps to begin with defined learning objectives and then building the AR experience to that objective or those objectives. Animations need to be informative (and occasionally, atmospheric or mood-setting). Sound should be informative (or occasionally mood-setting). In terms of interactions, users should be clear what may be interacted with (by proximity, by button pressing, and other actions). There should be clear digital signage if the AR experience is in an extended interior space, such as an art gallery or museum space. It helps to define opening scenes and exit scenes for learners. Such AR experiences are generally thought to be effective if they are brief and well-designed to avoid cybersickness or nausea (from the flicker and other aspects of the AR visual depictions).
Much more depth is included in some handouts created for those who would design immersive learning experiences using Adobe Aero.
URLs for Updated Adobe Aero Presentation Handout (in .docx and .pdf formats)
The cost of creation of AR experiences will vary, depending on the complexity of the teaching and learning. The research literature suggests mixed results in terms of AR efficacy for teaching and learning. There are many context-sensitive aspects that may determine effectiveness of the teaching and learning.
Most do agree that learning through AR involves higher cognitive load (more demands on attention and working memory).
Future-proofing the Digital Resources
As AR advances, which file types are mainstream, and which are more proprietary and closed will become clear. At present, there does not seem to be ways to “future-proof” .REAL files, which are inextricably linked to Aero. There may be some ways to transcode the file eventually to other file types that may “play well” with other systems.
Conclusion
Augmented reality (AR) may seem elusive in many instructional design shops, but it is not. Aero may serve as a bridge to AR as a proof-of-concept. It may serve as a bridge to more complex design, development, and deployment tools.
AR may be a portal to the metaverse.
About the Author
Shalin Hai-Jew works as an instructional designer at Kansas State University. Her email is shalin@ksu.edu.
1media/AdobeAeroinCloud_thumb.png2023-06-15T06:22:56-07:00Adobe Aero in the Cloud1This screenshot visual shows "Adobe Aero in the Cloud."media/AdobeAeroinCloud.pngplain2023-06-15T06:22:56-07:00
1media/Mars_thumb.jpg2023-06-20T11:05:39-07:00Far Side of Mars (from Deep Dream Generator)1This visual shows "Far Side of Mars" (from Deep Dream Generator).media/Mars.jpgplain2023-06-20T11:05:39-07:00
12023-06-14T13:30:56-07:00Lineup1This is a basic mobile augmented reality (mobile AR) video created from directable characters using Adobe Aero Beta.plain2023-06-14T13:30:56-07:00
12023-06-14T13:48:30-07:00Twirling AR Robot Next to a Laptop1This short video shows an "AR" robot twirling next to a laptop.plain2023-06-14T13:48:30-07:00
1media/AdobeAeroGUI_thumb.png2023-06-15T06:20:33-07:00Adobe Aero Graphical User Interface (GUI)1This diagram is "Adobe Aero Graphical User Interface (GUI) ."media/AdobeAeroGUI.pngplain2023-06-15T06:20:38-07:00
