Tag Archives: AR

Unleashing the Transformative Potential of Augmented Reality in Robotics

Augmented Reality, , , , ,

Augmented Reality Robotics

The integration of augmented reality (AR) and robotics has brought about countless benefits and transformed many industries. This integration of AR in robotics has proven to be a game-changer since the technology is becoming increasingly prevalent in various sectors. For instance, robots can now recognize objects in a 3D environment, allowing them to manipulate objects more effectively than ever before. This means that robots can perform tasks that would have been impossible for them to do previously.

In this blog post, we will explore the powerful impact of augmented reality in robotics and how it has become the forefront of innovation. We will dive into the effects of augmented reality technology on the robotics industry, including new developments, and increased efficiency.

Increased Efficiency

Using AR, robots can identify, locate and sort objects quickly and accurately, resulting in an improvement in performance and overall productivity. For instance, AR technology used in manufacturing has enabled robots to minimize errors in assembly lines. The robots can recognize a product and its details and perform assigning tasks with precision and accuracy. This minimizes errors, and the time spent on the task and thus increasing overall productivity outcomes. Below are some examples of how AR is further shaping the field of robotics:

Augmented Reality

Robot Programming:

AR can simplify the programming of robots by overlaying intuitive graphical interfaces onto the robot’s workspace. This allows operators to teach robots tasks by physically demonstrating them, reducing the need for complex coding and making it accessible to non-programmers.

Maintenance and Troubleshooting:

When robots require maintenance or encounter issues, technicians can use AR to access digital manuals, schematics, and step-by-step repair guides overlaid on the physical robot. This speeds up troubleshooting and maintenance, reducing downtime.

Training and Simulation:

AR-based training simulators provide a safe and cost-effective way to train robot operators. Trainees can interact with virtual robots and practice tasks in a simulated environment, which helps them become proficient in operating and maintaining actual robots more quickly.

Remote Operation and Monitoring:

AR allows operators to remotely control and monitor robots from a distance. This is particularly useful in scenarios where robots are deployed in hazardous or inaccessible environments, such as deep-sea exploration or space missions.

Augmented Reality

Quality Control and Inspection:

Robots equipped with AR technology can perform high-precision inspections and quality control tasks. AR overlays real-time data and images onto the robot’s vision, helping it identify defects, measure tolerances, and make real-time adjustments to improve product quality.

Inventory Management:

In warehouses and manufacturing facilities, AR-equipped robots can efficiently manage inventory. They use AR to recognize and locate items, helping in the organization, picking, and restocking of products.

Teleoperation for Complex Tasks:

For tasks that require human judgment and dexterity, AR can assist teleoperators in controlling robots remotely. The operator can see through the robot’s cameras, receive additional information, and manipulate objects in the robot’s environment, such as defusing bombs or performing delicate surgical procedures.

Robotics Research and Development:

Researchers and engineers working on robotics projects can use AR to visualize 3D models, simulations, and data overlays during the design and development phases. This aids in testing and refining robotic algorithms and mechanics.

Robot Fleet Management:

Augmented Reality

Companies with fleets of robots can employ AR to monitor and manage the entire fleet efficiently. Real-time data and performance metrics can be displayed through AR interfaces, helping organizations optimize robot usage and maintenance schedules.

Top Companies that Utilize Augmented Reality in Robotics

AR technology is widely adopted by companies worldwide to boost sales in their robotics systems. Notable players in this arena include Northrop Grumman, General Motors, and Ford Motor Company. Within the automotive industry, reliance on robotic systems is significant, and the integration of AR technology has yielded enhanced efficiency and reduced operating costs. Moreover, experts anticipate that AR technology could slash training time by up to 50% while boosting productivity by 30%.

These are a few instances of companies that employ augmented reality (AR) in the field of robotics:

  • iRobot: iRobot, the maker of the popular Roomba vacuum cleaner robots, has incorporated AR into its mobile app. Users can use the app to visualize cleaning maps and see where their Roomba has cleaned, providing a more informative and interactive cleaning experience.
  • Universal Robots: Universal Robots, a leading manufacturer of collaborative robots (cobots), offers an AR interface that allows users to program and control their robots easily. The interface simplifies the setup process and enables users to teach the robot by simply moving it through the desired motions.
  • Vuforia (PTC): PTC’s Vuforia platform is used in various industries, including robotics. Companies like PTC provide AR tools and solutions to create interactive maintenance guides, remote support, and training applications for robotic systems.
  • KUKA: KUKA, a global supplier of industrial robots, offers the KUKA SmartPAD, which incorporates AR features. The SmartPAD provides a user-friendly interface for controlling and programming KUKA robots, making it easier for operators to work with the robots.
  • RealWear: RealWear produces AR-enabled wearable devices, such as the HMT-1 and HMT-1Z1, which are designed for hands-free industrial use. These devices are used in robotics applications for remote support, maintenance, and inspections.
  • Ubimax: Ubimax offers AR solutions for enterprise applications, including those in robotics. Their solutions provide hands-free access to critical information, making it easier for technicians to perform maintenance and repairs on robotic systems.
  • Vicarious Surgical: Vicarious Surgical is developing a surgical robot that incorporates AR technology. Surgeons wear AR headsets during procedures, allowing them to see inside the patient’s body in real-time through the robot’s camera and control the robot’s movements with precision.

Collaborative Robotics

Collaborative robots, also known as cobots, are rapidly gaining traction across various industries. By leveraging augmented reality (AR), human workers can effortlessly command and interact with cobots, leading to improved tracking and precision. This collaborative synergy brings forth a multitude of advantages, such as error identification and prompt issue resolution. Consequently, this approach streamlines and optimizes manufacturing processes, ushering in enhanced efficiency and productivity.

Examples of Augmented Reality (AR) in Collaborative Robotics

Assembly and Manufacturing Assistance:

AR can provide assembly line workers with real-time guidance and visual cues when working alongside cobots. Workers wearing AR glasses can see overlays of where components should be placed, reducing errors and increasing assembly speed.

Quality Control:

In manufacturing, AR can be used to display quality control criteria and inspection instructions directly on a worker’s AR device. Cobots can assist by presenting parts for inspection, and any defects can be highlighted in real-time, improving product quality.

Collaborative Maintenance:

During maintenance or repair tasks, AR can provide technicians with visual instructions and information about the robot’s components. Cobots can assist in holding or positioning parts while the technician follows AR-guided maintenance procedures.

Training and Skill Transfer:

AR can facilitate the training of workers in cobot operation and programming. Trainees can learn how to interact with and program cobots through interactive AR simulations and tutorials, reducing the learning curve.

Safety Enhancements:

AR can display safety information and warnings to both human workers and cobots. For example, it can highlight no-go zones for the cobot, ensuring that it avoids contact with workers, or provide real-time feedback on human-robot proximity.

Collaborative Inspection:

In industries like aerospace or automotive manufacturing, workers can use AR to inspect large components such as aircraft wings or car bodies. AR overlays can guide cobots in holding inspection tools or cameras in the correct positions for thorough examinations.

Material Handling:

AR can optimize material handling processes by showing workers and cobots the most efficient paths for transporting materials. It can also provide real-time information about inventory levels and restocking requirements.

Dynamic Task Assignment:

AR systems can dynamically assign tasks to human workers and cobots based on real-time factors like workload, proximity, and skill levels. This ensures efficient task allocation and minimizes downtime.

Collaborative Training Environments:

AR can create shared training environments where human workers and cobots can practice collaborative tasks safely. This fosters better teamwork and communication between humans and robots.

Multi-robot Collaboration:

AR can help orchestrate the collaboration of multiple cobots and human workers in complex tasks. It can provide a centralized interface for monitoring, controlling, and coordinating the actions of multiple robots.

Data Visualization

AR can display real-time data and analytics related to cobot performance, production rates, and quality metrics, allowing workers to make informed decisions and adjustments. These are just some of the ways that AR can be used to optimize collaborative robotics applications. By taking advantage of AR-enabled solutions, companies can improve efficiency in their operations and reduce downtime. With its ability to facilitate human-robot collaboration and enhance safety protocols, AR is an invaluable tool for unlocking the potential of cobots in industrial use cases.

Augmented reality (AR) technology is the cornerstone of robotics development. It seamlessly brings together various elements, resulting in an enhanced human-robot interaction. By integrating AR into robotics, efficiency is increased, and errors are eliminated. Successful examples of AR integration in robotic systems serve as proof of the substantial benefits it brings to diverse industries, including manufacturing, healthcare, automotive, and entertainment. The challenge for businesses now lies in identifying the significant opportunities that this technology offers and harnessing them for optimal benefits.

The Future of Professional Sports: Augmented Reality

Augmented Reality, ,

The world of professional sports has always been at the forefront of utilizing cutting-edge technologies to enhance the experience of fans and improve team performance. One of the most exciting emerging technologies in this space is augmented reality (AR), which has the potential to revolutionize the way sports are played and viewed. Augmented reality involves overlaying digital information and images onto the real world, in real-time, through a device like a smartphone or AR headset. In this blog post, we will explore the technical side of AR in professional sports, including examples of teams that are already using AR to gain a competitive edge on the field.

Player Training and Performance Analysis

AR is already being used by professional sports teams to train and analyze player performance. For example, some basketball teams are using AR technology to track the shooting accuracy of their players during practice sessions. By overlaying digital targets and data onto a real basketball court, players can see how accurate their shots are and adjust their techniques accordingly. In football, AR is being used to simulate game scenarios and support off-field training for players. Coaches can use apps like NFL Game Theory to create plays and test them out in a digital environment. This allows players to become more familiar with different scenarios and improve their decision-making skills.

Enhancing Fan Engagement and Experience

In terms of fan engagement and experience, AR has opened up exciting new possibilities for professional sports teams. Manchester City FC, for instance, launched an AR app called “CityVR” in 2019 that allowed fans to explore their Etihad Stadium in 360 degrees, access exclusive content, and engage with the team in a fresh, immersive way. Similarly, the NBA’s Golden State Warriors used AR to improve fan engagement by bringing fans closer to the team’s pre-game rituals and player interactions through an official mobile app.

Several NFL teams, like the Tampa Bay Buccaneers and Baltimore Ravens, have also harnessed the power of AR to bring team mascots or famous players into fans’ surroundings through their mobile apps. Meanwhile, FC Barcelona enabled fans to interact with live AR stats, player statistics, and take a virtual tour of the iconic Camp Nou Stadium via their “Barça Live” AR app.

The Los Angeles Dodgers took the AR experience to the next level by providing AR glasses to fans during their games, overlaying real-time player statistics and information onto their view of the field. The San Francisco 49ers have also utilized AR in player training, developing a VR/AR-based program called “VRtize” to enhance game scenario understanding and decision-making among players.

The New York Yankees used AR to create interactive experiences for fans such as virtual tours of Yankee Stadium, while Formula 1 infused the fan experience with AR, enabling access to live data, track positions, and driver information during races via their F1 AR app. Various NHL and MLB teams have similarly leveraged AR to engage fans with initiatives like the Minnesota Wild’s AR app for photos with virtual players and the Boston Red Sox’s AR-based scavenger hunt within Fenway Park.

These diverse examples demonstrate how professional sports teams are leveraging augmented reality to connect with fans, enhance player performance, and create unique, interactive experiences both inside and outside the stadium. As AR technology continues to evolve, it is slated to play a significant role in shaping the future of sports entertainment.

Virtual Advertising

AR also provides a new way for teams to monetize their advertising real estate. Virtual advertising involves overlaying digital advertisements onto the real-world environment. This has the potential to revolutionize the way teams approach sponsorship deals, as they can now sell virtual ad space rather than relying solely on traditional advertising methods. For example, during an NFL game, virtual advertisements could be overlaid onto the field, visible to TV viewers but not to fans in the stadium.

AR-Enhanced Stadiums

Looking to the future, we can expect to see more stadiums and arenas incorporate AR technology directly into their architecture. For example, the forthcoming home stadium for the Golden State Warriors will include AR screens in its luxury suites, giving fans a more immersive experience during games. The Australian National Rugby League is also preparing to rollout AR technology in its stadiums, with the goal of enhancing the viewing experience for fans.

Challenges and Limitations

While AR has the potential to revolutionize professional sports, there are still challenges and limitations that must be overcome. One of the biggest issues is the cost and complexity of implementing AR technology. It requires significant investment in both hardware and software, as well as the expertise to develop and maintain AR applications. There are also concerns around data privacy and security, as AR applications often collect sensitive personal information.

In conclusion, augmented reality has the potential to significantly impact the world of professional sports, providing players with new training and analysis tools, fans with a more immersive viewing experience, and teams with new sources of revenue. However, there are still challenges and limitations that need to be overcome before AR becomes mainstream in this space. The good news is that we are already seeing some examples of teams successfully implementing AR, and as the technology becomes more advanced and accessible, we can expect to see even more exciting applications emerging. As always, staying ahead of the curve and embracing new technologies will be critical for maintaining a competitive edge in professional sports.

How 5G Is Unlocking the Hidden Potential of Mobile Gaming

Android Development, Gaming & Monetization Strategies, iOS Development, , , , , , , , , , , , , ,

5G is the fastest growing mobile generation of all time. There are 236 active 5G subscriptions with 3 billion 5G subscriptions anticipated by 2025. The vastly improved speed will have a transformative impact on a number of technologies—especially mobile gaming.

The game industry generates over $175 billion in revenue. Mobile gamers constitute over 2.6 billion mobile gamers worldwide. Mobile gaming is big business and 5G stands to unlock even more hidden potential in a variety of ways.

SAY GOODBYE TO LATENCY

Imagine thousands of players simultaneously playing Call of Duty on mobile devices with no lag and professional-level speed. Mobile operators like Ericsson are pushing the 5G revolution everyday to make these scenarios a reality.

In competitive gaming, latency can make or break a game. Online gamers can easily become frustrated and churn if latency ruins their experience. With speeds up to 10Gbps, 5G delivers 10 times the speed of 4G LTE. Response times as low as 5 milliseconds will virtually eliminate lag between input and response. As 5G becomes more reliable, it will hold true even for massive online games with a large number of competitors.

In a recent survey conducted by OpenSignal on the best networks for gaming experiences, mmWave 5G led the way—ahead of private wi-fi networks.

OFFLOADING PROCESSING

For IoT developers, 5G’s ability to bolster cloud computing poses major opportunities. 5G enables simple devices and sensors to complete complex tasks by offloading major processing duties to the cloud.

Mobile gaming can similarly benefit from the raw speed of 5G. Higher bandwidth and lower response times open up the possibility of offloading key processes. Games will be able to handle more arduous rendering duties remotely, producing a higher quality stream. With the cloud carrying the workload, the quality and age of the user’s device would matter significantly less provided the user has a 5G data plan. Gamers will still be able to expect the same high-quality experiences regardless of whether they have the latest smartphone.

AR AND VR BOON

Massive increases in streaming speed and cloud processing power will enable AR and VR developers to take their projects to the next level. Expect to see bigger, more detailed and immersive virtual worlds. For AR and VR apps to realize their potential, data needs to be rendered at the moment of decision-making. Lag and latency take users out of what’s intended to be the pinnacle of immersive gaming. The speeds of 5G will trigger a momentous evolution for AR and VR gaming.

CAN MOBILE GAMING OVERTAKE CONSOLES?

Smartphones provide game developers with the broadest platform and userbase. The bolstered processing power provided by smartphones with 5G will enable mobile devices to provide graphics on par with consoles. However, before mobile gaming can dethrone console gaming in terms of popularity, there are a few roadblocks.

While some major console games are available on mobile devices, the vast majority are not. Gamers are not at the point where they expect the same games on their mobile devices. Until game developers can effectively transfer major franchises to mobile devices, console gaming will remain king.

One of the major obstacles facing mobile gaming is the controller. iOS and Android touch screens simply cannot match the precision of playing on an Xbox Series X or PS5. Gamepads like the Backbone One latch onto smart devices to enable more fluid controls, but they also take away the mobile aspect of games since they are arduous to carry. Furthermore, they require every game to map inputs to each controller’s layout. The controller poses a simple but major problem and until it’s addressed, console gaming will provide more reliable experiences.

How Business Owners Can Leverage the Metaverse to Turn a Profit

Augmented Reality, Digital Marketing, Gaming & Monetization Strategies, Metaverse, , , , , , , , , ,

As many have heard, Facebook’s highly publicized rebranding as Meta in 2021 signaled their long-term expansion from social media into VR, the metaverse, and more. In the process, they launched the metaverse into a household name technology. The $500 million virtual real estate boom which proceeded only further hammered the point home—as far as Meta is concerned, the metaverse is the future. With VR and AR technologies developing at an astounding rate, businesses are entering the metaverse intent on generating revenue while the technology remains in its nascent stage.

The metaverse is here to stay—the question for business owners is: how can one take advantage of it? There is a long list of apps that use AR features to enhance the shopping experience. Sephora’s Virtual Artist app enables users to view how makeup will look before trying it on. The Ikea Place application enables users to view how furniture will look in their house before they place them.

The big question is: should you as a business owner delve into the metaverse? And if so, how can you leverage a metaverse presence to generate commerce? In this week’s blog, we present a few ideas to consider when making your decision.

REAL ESTATE

The first step to a metaverse presence is the acquisition of a virtual space for the business. Luckily, metaverse real estate has proven to be an extraordinarily profitable investment in and of itself. Armando Aguilar told Coindesk recently that the price of his three-bedroom, two-bathroom home outside New York City has appreciated two and a half times, while his metaverse property surged by 1,400% during that same time.

When purchasing real estate within the metaverse, consider which platform you’d like to see your company grow in. There’s a long list of options, from Sandbox to Decentraland, each with their own pros and cons.

When choosing a platform, consider which platform will provide the most short-term gains for your customers. Where do you anticipate long-term value? Investing wisely will lead to revenue as the price of virtual property rises.

For a list of the top metaverse platforms, check out XR Today’s list of the top metaverse platforms to watch in 2022.

EXPAND YOUR PHYSICAL PRESENCE

The metaverse presents an opportunity for companies to translate their brand into a virtual experience. Similar to the early aughts of the internet, companies which fail to capitalize on the new channel may lose money to companies that adopted the metaverse faster.

The metaverse differs from the internet in that it enables businesses to replicate three dimensional, physical spaces. This is a huge leap as we are physical beings and crave physical experiences.

While nothing can replace the physical retail experience, a great deal of commerce is generated by monetizing convenience. Delivery services like Amazon and Seamless generate billions of dollars in revenue by offering a variety of products to their customers through their digital presence, cutting out the need to stray from the home.

The metaverse capitalizes on our desire for physical experiences while enabling us to access them from the comfort of our couch. Rather than recreate their websites, businesses need to think about how they can create a physical experience for their customers.

Five years down the line, businesses will likely require a team of consultants and developers to build the metaverse experience. Check out the video below showing how Walmart created a physical shopping experience in the metaverse.

NFTs AND THE METAVERSE

Commerce in the metaverse will incorporate cryptocurrency and NFTs. NFTs, or nonfungible tokens, are unique digital files which function as certificates of ownership verified by the blockchain. They can be associated with any number of things—from sneakers, to songs and works of art. Although the market shows volatility similar to cryptocurrency, NFT value can appreciate by quite a bit.

NFTs represent a new buying channel that’s crucial to the metaverse. Creating exclusive experiences in the metaverse will draw your customers in.

Offering exclusive NFTs is a way to both create value and boost engagement with your customers. Adidas recently took advantage of this, generating over $23 million in ethereum in their first NFT drop.

Consider incorporating NFT’s alongside physical product drops. For example, offer an NFT to customers who enter the metaverse to make early pre-orders of future releases.

The metaverse is an opportunity to drive engagement and create value by offering personalized, exclusive experiences to your customers. NFTs are the perfect method to achieve this.

CONCLUSION

The metaverse poses a business opportunity for enterprises unafraid of innovation. What kind of experience can you deliver to your customers in the metaverse that you cannot in any other realm? Businesses which manage to answer that question will be rewarded with long-term profit.

Learn How Google Bests ARKit with Android’s ARCore

Android Development, Augmented Reality, , , , , , , , , , , , , ,

Previously, we covered the strengths of ARKit 4 in our blog Learn How Apple Tightened Their Grip on the AR Market with the Release of ARKit 4. This week, we will explore all that Android’s ARCore has to offer.

All signs point toward continued growth in the Augmented Reality space. As the latest generations of devices are equipped with enhanced hardware and camera features, applications employing AR have seen increasing adoption. While ARCore represents a breakthrough for the Android platform, it is not Google’s first endeavor into building an AR platform.

HISTORY OF GOOGLE AR

In summer 2014, Google launched their first AR platform Project Tango.

Project Tango received consistent updates, but never achieved mass adoption. Tango’s functionality was limited to three devices which could run it, including the Lenovo Phab 2 Pro which ultimately suffered from numerous issues. While it was ahead of its time, it didn’t receive the level of hype ARKit did. In March 2018, Google announced that it will no longer support Project Tango and that the tech titan will be continuing AR Development with ARCore.

ARCORE

ARCore uses three main technologies to integrate virtual content with the world through the camera:

  • Motion tracking
  • Environmental understanding
  • Light estimation

It tracks the position of the device as it moves and gradually builds its own understanding of the real world. As of now, ARCore is available for development on the following devices:

ARCORE VS. ARKIT

ARCore and ARKit have quite a bit in common. They are both compatible with Unity. They both feature a similar level of capability for sensing changes in lighting and accessing motion sensors. When it comes to mapping, ARCore is ahead of ARKit. ARCore has access to a larger dataset which boosts both the speed and quality of mapping achieved through the collection of 3D environmental information. ARKit cannot store as much local condition data and information. ARCore can also support cross-platform development—meaning you can build ARCore applications for iOS devices, while ARKit is exclusively compatible with iOS devices.

The main cons of ARCore in relation to ARKit mainly have to do with their adoption. In 2019, ARKit was on 650 million devices while there were only 400 million ARCore-enabled devices. ARKit yields 4,000+ results on GitHub while ARCore only contains 1,400+. Ultimately, iOS devices are superior to software-driven Android devices—particularly given the TrueDepth Camera—meaning that AR applications will run better on iOS devices regardless of what platform they are on.

OVERALL

It is safe to say that ARCore is the more robust platform for AR development; however, ARKit is the most popular and most widely usable AR platform. We recommend spending time determining the exact level of usability you need, as well as the demographics of your target audience.

For supplementary reading, check out this great rundown of the best ARCore apps of 2021 from Tom’s Guide.

Learn More About Triggering Augmented Reality Experiences with AR Markers

Android Development, Digital Marketing, iOS Development, , , , , , , , , , , , , , , ,

We expect a continued increase in the utilization of AR in 2021. The iPhone 12 contains LiDAR technology, which enables the use of ARKit 4, greatly enhancing the possibilities for developers. When creating an AR application, developers must consider a variety of methods for triggering the experience and answer several questions before determining what approach will best facilitate the creation of a digital world for their users. For example, what content will be displayed? Where will this content be placed, and in what context will the user see it?

Markerless AR can best be used when the user needs to control the placement of the AR object. For example, the IKEA Place app allows the user to place furniture in their home to see how it fits.

1_0RtFp6lxeJWxcg5EE_wYCg

Location-based AR roots an AR experience to a physical space in the world, as we explored previously in our blog Learn How Apple Tightened Their Hold on the AR Market with the Release of ARKit 4. ARKit 4 introduces Location Anchors, which enable developers to set virtual content in specific geographic coordinates (latitude, longitude, and altitude). To provide more accuracy than location alone, location anchors also use the device’s camera to capture landmarks and match them with a localization map downloaded from Apple Maps. Location anchors greatly enhance the potential for location-based AR; however, the possibilities are limited within the 50 cities which Apple has enabled them.

Marker-based AR remains the most popular method among app developers. When an application needs to know precisely what the user is looking at, accept no substitute. In marker-based AR, 3D AR models are generated using a specific marker, which triggers the display of virtual information. There are a variety of AR markers that can trigger this information, each with its own pros and cons. Below, please find our rundown of the most popular types of AR markers.

FRAMEMARKERS

5fc9da7d2761437fecd89875_1_gXPr_vwBWmgTN5Ial7Uwhg

The most popular AR marker is a framemarker, or border marker. It’s usually a 2D image printed on a piece of paper with a prominent border. During the tracking phase, the device will search for the exterior border in order to determine the real marker within.

Framemarkers are similar to QR Codes in that they are codes printed on images that require handheld devices to scan, however, they trigger AR experiences, whereas QR codes redirect the user to a web page. Framemarkers are a straightforward and effective solution.

absolut-truths

Framemarkers are particularly popular in advertising applications. Absolut Vodka’s Absolute Truth application enabled users to scan a framemarker on a label of their bottle to generate a slew of more information, including recipes and ads.

GameDevDad on Youtube offers a full tutorial of how to create framemarkers from scratch using Vuforia Augmented Reality SDK below.

 

NFT MARKERS

?????????

NFT, or Natural Feature Tracking, enable camera’s to trigger an AR experience without borders. The camera will take an image, such as the one above, and distill down it’s visual properties as below.

AugementedRealityMarkerAnymotionFeatures

The result of processing the features can generate AR, as below.

ImEinsatz

The quality and stability of these can oscillate based on the framework employed. For this reason, they are less frequently used than border markers, but function as a more visually subtle alternative. A scavenger hunt or a game employing AR might hide key information in NFT markers.

Treasury Wine Estates Living Wine Labels app, displayed above, tracks the natural features of the labels of wine bottles to create an AR experience which tells the story of their products.

OBJECT MARKERS

image1-7

The  toy car above has been converted into an object data field using Vuforia Object Scanner.

image4-1

Advancements in technology have enabled mobile devices to solve the issue of SLAM (simultaneous localization and mapping). The device camera can extract information in-real time, and use it to place a virtual object in it. In some frameworks, objects can become 3D-markers. Vuforia Object Scanner is one such framework, creating object data files that can be used in applications for targets. Virtual Reality Pop offers a great rundown on the best object recognition frameworks for AR.

RFID TAGS

Although RFID Tags are primarily used for short distance wireless communication and contact free payment, they can be used to trigger local-based virtual information.

While RFID Tags are not  widely employed, several researchers have written articles about the potential usages for RFID and AR. Researchers at the ARATLab at the National University of Singapore have combined augmented reality and RFID for the assembly of objects with embedded RFID tags, showing people how to properly assemble the parts, as demonstrated in the video below.

SPEECH MARKERS

Speech can also be used as a non-visual AR marker. The most common application for this would be for AR glasses or a smart windshield that displays information through the screen requested by the user via vocal commands.

CONCLUSION

Think like a user—it’s a staple coda for app developers and no less relevant in crafting AR experiences. Each AR trigger offers unique pros and cons. We hope this has helped you decide what is best equipped for your application.

In our next article, we will explore the innovation at the heart of AIoT, the intersection of AI and the Internet of Things.

Learn How Apple Tightened Their Hold on the AR Market with the Release of ARKit 4

iOS Development, , , , , , , , , , , , ,

Since the explosive launch of Pokemon Go, AR technologies have vastly improved. Our review of the iPhone 12 concluded that as Apple continues to optimize its hardware, AR will become more prominent in both applications and marketing.

At the 2020 WWDC in June, Apple announced ARKit 4, their latest iteration of the famed augmented reality platform. ARKit 4 features some vast improvements that help Apple tighten their hold on the AR market.

LOCATION ANCHORS

ARKit 4 introduces location anchors, which allow developers to set virtual content in specific geographic coordinates (latitude, longitude, and altitude). When rebuilding the data backend for Apple Maps, Apple collected camera and 3D LiDAR data from city streets across the globe. ARKit downloads the virtual map surrounding your device from the cloud and matches it with the device’s feed to determine your location. The kicker is: all processing happens using machine learning within the device, so your camera feed stays put.

36431-67814-ARKit-xl

Devices with an A12 chip or later, can run Geo-tracking; however, location anchors require Apple to have mapped the area previously. As of now, they are supported in over 50 cities in the U.S. As the availability of compatible devices increases and Apple continues to expand its mapping project, location anchors will find increased usage.

DEPTH API

ARKit’s new Depth API harnesses the LiDAR scanner available on iPad Pro and iPhone 12 devices to introduce advanced scene understanding and enhanced pixel depth information in AR applications. When combined with 3D mesh data derived from Scene Geometry, which creates a 3D matrix of readings of the environment, the Depth API vastly improves virtual object occlusion features. The result is the instant placement of digital objects and seamless blending with their physical surroundings.

FACE TRACKING

1_tm5vrdVDr2DAulgPvDMRow

Face tracking has found an exceptional application in Memojis, which enables fun AR experiences for devices with a TrueDepth camera. ARKit 4 expands support to devices without a camera that has at least an A12. TrueDepth cameras can now leverage ARKit 4 to track up to three faces at once, providing many fun potential applications for Memojis.

VIDEO MATERIALS WITH REALITYKIT

b3b1c224-5db5-4e38-97de-76f90c32b53a

ARKit 4 also brings with it RealityKit, which adds support for applying video textures and materials to AR experiences. For example, developers will be able to place a virtual television on a wall, complete with realistic attributes, including light emission, texture roughness, and even audio. Consequentially, AR developers can develop even more immersive and realistic experiences for their users.

CONCLUSION

iOS and Android are competing for supremacy when it comes to AR development. While the two companies’ goals and research overlap, Apple has a major leg up on Google in its massive base of high-end devices and its ability to imbue them with the necessary structure sensors like TrueDepth and LiDAR.

ARKit has been the biggest AR development platform since it hit the market in 2017. ARKit 4 provides the technical capabilities tools for innovators and creative thinkers to build a new world of virtual integration.

How App Developers Can Leverage the iPhone 12 to Maximize Their Apps

iOS Development, , , , , , , , , , , , , ,

On October 23rd, four brand new iPhone 12 models were released to retailers. As the manufacturer of the most popular smartphone model in the world, whenever Apple delivers a new device its front-page news. Mobile app developers looking to capitalize on new devices must stay abreast of the latest technologies, how they empower applications, and what they signal about where the future of app development is headed.

With that in mind, here is everything app developers need to know about the latest iPhone models.

BIG DEVELOPMENTS FOR AUGMENTED REALITY

LiDAR is a method for measuring distances (ranging) by illuminating the target with laser light and measuring the reflection with a sensor
LiDAR is a method for measuring distances (ranging) by illuminating the target with laser light and measuring the reflection with a sensor

On a camera level, the iPhone 12 includes significant advancements. It is the first phone to record and edit Dolby Vision with HDR. What’s more, Apple has enhanced the iPhone’s LiDAR sensor capabilities with a third telephoto lens.

The opportunities for app developers are significant. For AR developers, this is a breakthrough—enhanced LiDAR on the iPhone 12 means a broad market will have access to enhanced depth perception, enabling smoother AR object placement. The LIDAR sensor produces a 6x increase in autofocus speed in low light settings.

The potential use cases are vast. An enterprise-level application could leverage the enhanced camera to show the inner workings of a complex machine and provide solutions. Dimly lit rooms can now house AR objects, such as Christmas decorations. The iPhone 12 provides a platform for AR developers to count on a growing market of app users to do much more with less light, and scan rooms with more detail.

The iPhone 12’s enhanced LiDAR Scanner will enable iOS app developers to employ Apple’s ARKit 4 to attain enhanced depth information through a brand-new Depth API. ARKit 4 also introduces location anchors, which enable developers to place AR experiences at a specific point in the world in their iPhone and iPad apps.

With iPhone 12, Apple sends a clear message to app developers: AR is on the rise.

ALL IPHONE 12 MODELS SUPPORT 5G

5G 2

The entire iPhone 12 family of devices supports 5G with both sub-6GHz and mmWave networks. When iPhone 12 devices leverage 5G with the Apple A14 bionic chip, it enables them to integrate with IoT devices, and perform on ML algorithms at a much higher level.

5G poses an endless array of possibilities for app developers—from enhanced UX, more accurate GPS, improved video apps, and more. 5G will reduce dependency on hardware as app data is stored in the cloud with faster transfer speeds. In addition, it will enable even more potential innovation for AR applications.

5G represents a new frontier for app developers, IoT, and much more. Major carriers have been rolling out 5G networks over the past few years, but access points remain primarily in major cities. Regardless, 5G will gradually become the norm over the course of the next few years and this will expand the playing field for app developers.

WHAT DOES IT MEAN?

Beyond the bells and whistles, the iPhone 12 sends a very clear message about what app developers can anticipate will have the biggest impact on the future of app development: AR and 5G. Applications employing these technologies will have massive potential to evolve as the iPhone 12 and its successors become the norm and older devices are phased out.

How to Leverage AR to Boost Sales and Enhance the Retail Experience

Android Development, Digital Marketing, iOS Development, , , , , , , , , , , , , , , , , , , , ,

The global market for VR and AR in retail will reach $1.6 billion by 2025 according to research conducted by Goldman Sachs. Even after years of growing popularity, effectively employed Augmented Reality experiences feel to the end-user about as explicitly futuristic as any experience created by popular technology.

We have covered the many applications for AR as an indoor positioning mechanism on the Mystic MediaTM blog, but when it comes to retail, applications for AR are providing real revenue boosts and increased conversion rates.

Augmented Reality (AR) History

Ivan Sutherland 1

While working as an associate professor at Harvard University, computer scientist Ivan Sutherland, aka the “Father of Computer Graphics”, created an AR head-mounted display system which constituted the first AR technology in 1968. In the proceeding decades, AR visual displays gained traction in universities, companies, and national agencies as a way to superimpose vital information on physical environments, showing great promise for applications for aviation, military, and industrial purposes.

Fast forward to 2016, the sensational launch of Pokemon GO changed the game for AR. Within one month, Pokemon GO reached 45 million users, showing there is mainstream demand for original and compelling AR experiences.

Cross-Promotions

Several big brands took advantage of Pokemon GO’s success through cross-promotions. McDonald’s paid for Niantic to turn 3,000 Japan locations into gyms and PokeStops, a partnership that has recently ended. Starbucks took advantage of Pokemon GO’s success as well by enabling certain locations to function as PokeStops and gyms, and offering a special Pokemon GO Frappucino.

One of the ways retailers can enter into the AR game without investing heavily in technology is to cross-promote with an existing application.

In 2018, Walmart launched a partnership with Jurassic World’s AR game: Jurassic World Alive. The game is similar to Pokemon GO, using a newly accessible Google Maps API to let players search for virtual dinosaurs and items on a map, as well as battle other players. Players can enter select Walmart locations to access exclusive items.

Digital-Physical Hybrid Experiences

The visual augmentation produced by AR transforms physical spaces by leveraging the power of computer-generated graphics, an aesthetic punch-up proven to increase foot traffic. While some retailers are capitalizing on these hybrid experiences through cross-promotions, others are creating their own hybrid experiential marketing events.

Foot Locker developed an AR app that used geolocation to create a scavenger hunt in Los Angeles, leading customers to the location where they could purchase a pair of LeBron 16 King Court Purple shoes. Within two hours of launching the app, the shoes sold out.

AR also has proven potential to help stores create hybrid experiences through indoor navigation. Users can access an augmented view of the store through their phones, which makes in-store navigation easy. Users scan visual markers, recognized by Apple’s ARKit, Google’s ARCore, and other AR SDKs, to establish their position, and AR indoor navigation applications can offer specific directions to their desired product.

Help Consumers Make Informed Choices

Ikea Place Screenshots

AR is commonly employed to enrich consumers’ understanding of potential purchases and prompt them to buy. For example, the “IKEA Place” app allows shoppers to see IKEA products in a superimposed graphics environment. IKEA boasts the app gives shoppers 98% accuracy in buying decisions.

Converse employs a similar application, the “Converse Sampler App”, which enables users to view what a shoe will look like on their feet through their device’s camera. The application increases customer confidence, helping them make the decision to purchase.

Treasury Wines Estates enhances the consumer experience with “Living Wine Labels”: AR labels that bring the history of the vineyard to life and provide users with supplementary information, including the history of the vineyard the wine came from and tasting notes.

Conclusion

AR enables striking visuals that captivate customers. As a burgeoning tool, AR enables companies to get creative and build innovative experiences that capture their customers’ imagination. Retailers who leverage AR will seize an advantage both in the short term and in the long term as the technology continues to grow and evolve.

The Future of Indoor GPS Part 5: Inside AR’s Potential to Dominate the Indoor Positioning Space

Android Development, Artificial Intelligence & Machine Learning, iOS Development, , , , , , , , , , , , , , ,

In the previous installment of our blog series on indoor positioning, we explored how RFID Tags are finding traction in the indoor positioning space. This week, we will examine the potential for AR Indoor Positioning to receive mass adoption.

When Pokemon Go accrued 550 million installs and made $470 million in revenues in 2016, AR became a household name technology. The release of ARKit and ARCore significantly enhanced the ability for mobile app developers to create popular AR apps. However, since Pokemon Go’s explosive release, no application has brought AR technology to the forefront of the public conversation.

When it comes to indoor positioning technology, AR has major growth potential. GPS is the most prevalent technology navigation space, but it cannot provide accurate positioning within buildings. GPS can be accurate in large buildings such as airports, but it fails to locate floor number and more specifics. Where GPS fails, AR-based indoor positioning systems can flourish.

HOW DOES IT WORK?

AR indoor navigation consists of three modules: Mapping, Positioning, and Rendering.

via Mobi Dev
via Mobi Dev

Mapping: creates a map of an indoor space to make a route.

Rendering: manages the design of the AR content as displayed to the user.

Positioning: is the most complex module. There’s no accurate way of using the technology available within the device to determine the precise location of users indoors, including the exact floor.

AR-based indoor positioning solves that problem by using Visual Markers, or AR Markers, to establish the users’ position. Visual markers are recognized by Apple’s ARKit, Google’s ARCore, and other AR SDKs.  When the user scans that marker, it can identify exactly where the user is and provide them with a navigation interface. The further the user is from the last visual marker, the less accurate their location information becomes. In order to maintain accuracy, developers recommend placing visual markers every 50 meters.

Whereas beacon-based indoor positioning technologies can become expensive quickly, running $10-20 per beacon with a working range of around 10-100 meters of accuracy, AR visual markers are the more precise and cost-effective solution with an accuracy threshold down to within millimeters.

Via View AR
Via View AR

CHALLENGES

Performance can decline when more markers have been into an AR-based VPS because all markers must be checked to find a match. If the application is set up for a small building where 10-20 markers are required, it is not an issue. If it’s a chain of supermarkets requiring thousands of visual markers across a city, it becomes more challenging.

Luckily, GPS can help determine the building where the user is located, limiting the number of visual markers the application will ping. Innovators in the AR-based indoor positioning space are using hybrid approaches like this to maximize precision and scale of AR positioning technologies.

CONCLUSION

AR-based indoor navigation has had few cases and requires further technical development before it can roll out on a large scale, but all technological evidence indicates that it will be one of the major indoor positioning technologies of the future.

This entry concludes our blog series on Indoor Positioning, we hope you enjoyed and learned from it! In case you missed it, check out our past entries:

The Future of Indoor GPS Part 1: Top Indoor Positioning Technologies

The Future of Indoor GPS Part 2: Bluetooth 5.1′s Angle of Arrival Ups the Ante for BLE Beacons

The Future of Indoor GPS Part 3: The Broadening Appeal of Ultra Wideband

The Future of Indoor GPS Part 4: Read the Room with RFID Tags