Integrated Visual Augmentation System

Integrated Visual Augmentation System
Soldier dons IVAS 1.2 Prototype during user assessment.
TypeAugmented reality headset
Place of originUnited States
Production history
DesignerMicrosoft
Designed2018
Specifications
Weight3.4 lb (1.5 kg)

The Integrated Visual Augmentation System (IVAS) is an augmented reality headset being developed by Microsoft for the United States Army. It is intended to improve situational awareness by overlaying sensor imagery and other information on the soldier's field of view. Originally developed for infantry, it is also being adapted for use by mounted soldiers and aircrew.

Its development begun in 2018 and is currently undergoing testing. Initially intended to be fielded in 2021, ergonomic and reliability issues have pushed this date back to 2025. Soldiers and offices of the Department of Defense and Congress have repeatedly criticized the device and its development process for issues with technology and project management.

Design

[edit]

IVAS is an augmented reality system based on the Microsoft Hololens 2 headset.[1] It intends to provide soldiers with "improved situational awareness, target engagement, and informed decision-making".[2]

The system consists of a display, a computer known as a "puck", a networked data radio, and three conformal batteries. The display can augment the soldier's vision with imagery from thermal imaging and low-light imaging sensors. The radio allows data from the soldiers' individual IVAS headsets to be passed among members of the company.[3]

Mounted soldier wearing IVAS

The latest version of IVAS, version 1.2, weighs 3.4 pounds (1.5 kg), although developers are working to reduce this to the target weight of 2.9 pounds (1.3 kg). The computer is attached to the back of the helmet to distribute weight and move the center of mass. The display has a field of view of 60 degrees, using a flat display that can be flipped upwards.[4]

Software installed in the computer allows IVAS to perform many functions. Version 1.2 introduced an embedded training tool known as the "Squad Immersive Virtual Trainer", a piece of software that can project holographic and mixed reality imagery via the IVAS headset to help train soldiers in combat.[5] Navigation applications can display maps of terrain and interiors of buildings, and show the positions of friendly and enemy forces. New kinds of software can also be developed and uploaded to expand IVAS's capabilities; examples include designating fields of fire for machine gunners, generating medivac reports, and conducting field surgery assisted by augmented reality.[6]

In March 2021, the U.S. Army announced that IVAS was being tested with mounted soldiers, such as on Bradley Fighting Vehicle and Stryker teams.[7] By June 2021, the US Army announced it was expanding IVAS tests to include aircrews for helicopters and drones.[8] In comparison to the US$400,000 purely-slaved and aircraft-dependent F-35 helmet that must be custom-built for each pilot,[9] IVAS attached to any helmet, was estimated to cost US$29,205 per unit, and could optionally work independently of the aircraft when the crew dismounts.[10]

Development

[edit]

Although it is unknown when the idea for IVAS was first conceived, the Army Acquisition Executive first approved IVAS's development effort on 25 September 2018, and an Other Transaction Agreement for the development of IVAS was issued to Microsoft in November 2018. Initial testing began in March 2019.[11]

2020

[edit]

Early models of IVAS were very similar to civilian HoloLens 2 headsets, which were not resistant to inclement weather and could not even function in rain.[1][12] IVAS entered its third iteration in October 2020, the first version to be ruggedized for military use. The system was tested in late October 2020 at Fort Pickett by some Marines and members of the 82nd Airborne Division. The test was to get soldier feedback and refine the system for eventual battlefield use.[1]

2021

[edit]
IVAS Capability Set 4 during testing at Fort Greely, Alaska

After nearly 2 years in development, the final IVAS Capability Set 4 system was scheduled to be fielded in 2021. Over 40,000 sets were planned to be issued.[1]

On 26 March 2021, Microsoft was awarded a "fixed price production agreement" by the United States Army to manufacture and supply IVAS headsets.[13] Microsoft would produce headsets for at least 120,000 members of the Army Close Combat Force.[14] The contract was worth up to US$21.88 billion.[15]

In September 2021, an "Adversarial Electronic Warfare and Cybersecurity Test" of IVAS was conducted.[16] In mid-October, the system's "Operational Test and fielding" was moved to 2022. David Patterson, PEO Soldier Director of Public Affairs, said: "The Army intends to continue developing and fielding this revolutionary, first-of-its-kind technology in FY22."[16]

2022

[edit]

Initial operational testing of IVAS began in May 2022 and concluded in late June, although at the time it was believed that the fielding of IVAS in September was unlikely.[17][18] Nevertheless, in September 2022, the US Army began accepting 5,000 units of the IVAS and was planning to field them, even though these units were still early versions of the IVAS and would require future software upgrades.[19] However, in November 2022, the US Army announced a "course correction" to the program, due to soldiers reporting physical ailments after using IVAS in the field. [20] The main symptoms were headaches, eye strain, and nausea. A report by the Department of Defense Office of Inspector General raised concerns that these problems may lead to soldiers not using the system even if it was issued to them.[21] The US Army and Microsoft decided to renegotiate their contract and redesign the form factor while still planning to field 10,000 initial units.[20]

2023

[edit]
Version 1.2 with flat display and computer on the rear of the helmet

In March 2023, following the "course correction" to the program with Microsoft, the US Army exhibited IVAS version 1.2. Although the new variant was still based on the civilian HoloLens headset, there had been some changes from previous versions, such as the separation of the controller from the computer, with the controller now able to be attached to any part of the upper torso and the computer being mounted on the rear of the helmet.[22] The previous helmet-like display was replaced by a flat display with better clarity, better line-of-sight, and also a hinge that allows the display to be flipped up. As a result, the field of view was reduced from 70 degrees to 60 degrees. The thermal camera was also being improved to increase clarity while reducing power consumption.[4]

Problems still existed in the new version. The newly added "Squad Immersive Virtual Trainer" encountered an issue known as "dynamic occlusion limitations", which was the inability of augmented reality devices to simulate how the user's view of virtual objects was blocked by real objects. Experts in the field had yet to find a general solution to the issue, although the US Army stated that it would work to fix it.[23]

Testing of IVAS 1.2 began in August after 20 prototypes were delivered to the US Army.[5] Microsoft was awarded another US$95 million for the next stage of the program, which included the delivery of 280 pre-production and "production representative" IVAS 1.2 systems for testing in Fiscal Year 2024, aiming to field an improved version of IVAS in Fiscal Year 2025.[24]

Reception

[edit]

In February 2019, not long after the contract for developing IVAS was signed between Microsoft and the US Army, more than 50 employees signed a petition calling for Microsoft to cancel the contract, saying that they "didn't want to become war profiteers".[25] The petition stated that Microsoft had misled its engineers on how their products would be used; rather than being beneficial for civilians, they believed that the Hololens is now being used to "help people kill".[26] Satya Nadella, CEO of Microsoft, defended the contract, saying that the company is "not going to withhold technology from institutions that we have elected in democracies to protect the freedoms we enjoy".[27]

The various issues in the system's development have often caused concern in the United States Congress. In December 2020, Congress decided to cut US$230 million of the US$1.1 billion request for the Army's IVAS goggles. It also wanted the US Army to submit a report detailing the acquisition strategy for the IVAS program by 15 August 2021.[28] In March 2022, considering the numerous technical issues the program encountered, Congress again withheld approximately US$400 million in funding for the program until IVAS completed its initial operation testing and the Program Executive Office Soldier briefed the appropriations committees on the program's progress.[29][30]

Soldiers involved in testing IVAS also expressed their dissatisfaction with the system. One soldier commented that "the devices would have gotten us killed", referring to the glow emitted by the headset that can be seen from hundreds of meters away. They were also concerned about the limited peripheral vision and the bulkiness of the system that restricted their movement.[31] In an "unusually stinging" report, the Department of Defense Inspector General stated that the US Army wasn't effectively measuring user satisfaction with IVAS and that it was "wasting money" if soldiers don't like the system. The Army contested the report's conclusions, describing them as "fundamentally flawed and inflammatory", although the Army partially agreed with recommendations to better measure acceptance of the system.[32]

The Director, Operational Test and Evaluation report published in January 2023 criticized the performance of IVAS 1.0 in tests. It stated that most soldiers testing the IVAS headset reported a wide range of physical impairments and numerous technical deficiencies that negatively impacted their performance. It found that soldiers accomplished their missions better with their current equipment than with IVAS. Furthermore, there were no improvements and even declines in the system's reliability throughout its development.[3]

Despite the numerous issues and criticisms, the US Army remained optimistic about the program. Doug Bush, the Assistant Secretary of the Army for Acquisition, Logistics, and Technology, believed that the program is "on a good track", saying: "I think early returns are positive, which is a good thing to see."[24] A news release from the US Army stated that despite the previous delays, IVAS will still be fielded "several years ahead of standard acquisition programs".[33]

References

[edit]
  1. ^ a b c d Keller, Jared (3 November 2020). "The Army's next-generation headset is almost ready for prime time". Task & Purpose. Archived from the original on 17 November 2020. Retrieved 18 November 2020.
  2. ^ "IVAS Production Contract Award". U.S. Army Program Executive Office Soldier. 31 March 2021. Archived from the original on 1 April 2021. Retrieved 5 May 2021.
  3. ^ a b "FY 2022 DOT&E Annual Report submitted to Congress" (PDF). Director Operational Test and Evaluation. January 2023. p. 110. Archived (PDF) from the original on 15 May 2023. Retrieved 15 May 2023.
  4. ^ a b Roque, Ashley (10 May 2023). "Last stand for IVAS? New challenges, delays as Army debates future of augmented reality goggles". Breaking Defense. Archived from the original on 4 November 2023. Retrieved 15 June 2023.
  5. ^ a b Shear, Frederick (1 August 2023). "Army accepts prototypes of the most advanced version of IVAS". U.S. Army. Archived from the original on 25 October 2023. Retrieved 25 October 2023.
  6. ^ South, Todd (29 December 2023). "Army's mixed reality device nears fielding with final testing in 2024". Army Times. Retrieved 16 January 2024.
  7. ^ Mizokami, Kyle (8 March 2021). "The Army's New Goggles Let Soldiers See Right Through Walls". Popular Mechanics. Archived from the original on 10 September 2021. Retrieved 10 September 2021.
  8. ^ Cureton, Demond (30 June 2021). "US Army Integrates IVAS Headsets For Aircraft Crews". XRToday.com. Archived from the original on 10 September 2021. Retrieved 10 September 2021.
  9. ^ Swarts, Phillip (26 October 2015). "F-35 helmet costs $400,000 — 4 times that of predecessor". Air Force Times. Archived from the original on 14 January 2024. Retrieved 10 September 2021.
  10. ^ Roque, Ashley (1 June 2021). "Pentagon budget 2022: US Army plans to spend USD29,205 per IVAS unit". Janes.com. Archived from the original on 10 September 2021. Retrieved 10 September 2021.
  11. ^ "Director, Operational Test and Evaluation FY 2019 Annual Report" (PDF). Director, Operational Test and Evaluation. 20 December 2019. p. 85. Archived (PDF) from the original on 1 December 2023. Retrieved 15 June 2023.
  12. ^ Freedberg Jr., Sydney J. (5 October 2020). "From 'Frankengoggle' To Battle-Ready: Army IVAS". Breaking Defense. Archived from the original on 5 October 2023. Retrieved 5 December 2023.
  13. ^ Patterson, David (31 March 2021). "IVAS Production Contract Award". U.S. Army Program Executive Office Soldier. Archived from the original on 31 March 2021. Retrieved 1 April 2021.
  14. ^ O'Brien, Matt (31 March 2021). "Microsoft wins $22 billion deal making headsets for US Army". The Seattle Times. The Associated Press. Archived from the original on 22 April 2021. Retrieved 1 April 2021.
  15. ^ Freedberg Jr, Sydney J. (31 March 2021). "IVAS: Microsoft Award By Army Worth Up To $21.9B". Breaking Defense. Archived from the original on 31 March 2021. Retrieved 1 April 2021.
  16. ^ a b Foley, Mary Jo (15 October 2021). "U.S. Army postpones its $22 billion Microsoft augmented-reality headset deliverables to late 2022". ZDNET. Archived from the original on 31 October 2021. Retrieved 31 October 2021.
  17. ^ Roque, Ashley (5 May 2022). "US Army greenlights IVAS initial operational test and evaluation for mid-May". Janes Information Services. Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  18. ^ Roque, Ashley (27 July 2022). "US Army weighing IVAS production decision, unlikely to meet September fielding date". Janes Information Services. Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  19. ^ Roque, Ashley (9 September 2022). "US Army receiving early IVAS units, will roll out software upgrades". Janes Information Services. Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  20. ^ a b Roque, Ashley (9 November 2022). "Course correction: US Army renegotiating USD22 billion IVAS contract, eyeing path for different form factor". Janes Information Services. Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  21. ^ Atherton, Kelsey D. (22 October 2022). "Why the Army hates AR goggles". Popular Science. Archived from the original on 15 May 2023. Retrieved 15 May 2023.
  22. ^ South, Todd (5 April 2023). "Changes ahead in the next version of the Army's 'mixed reality' goggle". Army Times. Archived from the original on 9 April 2023. Retrieved 28 April 2023.
  23. ^ Roque, Ashley (3 August 2023). "Army's pricey IVAS goggles meet a training obstacle: Doors". Breaking Defense. Archived from the original on 10 November 2023. Retrieved 25 October 2023.
  24. ^ a b Harper, Jon (21 September 2023). "Army awards Microsoft $95M for additional IVAS 1.2 headsets, virtual trainers". DefenseScoop. Archived from the original on 25 October 2023. Retrieved 25 October 2023.
  25. ^ Wong, Julia Carrie (22 February 2019). "'We won't be war profiteers': Microsoft workers protest $480m army contract". The Guardian. Archived from the original on 23 February 2019. Retrieved 14 February 2024.
  26. ^ Lee, Dave (22 February 2019). "Microsoft staff: Do not use HoloLens for war". BBC News. Archived from the original on 14 February 2024. Retrieved 14 February 2024.
  27. ^ Riley, Charles; Burke, Samuel (25 February 2019). "Microsoft CEO defends US military contract that some employees say crosses a line | CNN Business". CNN Business. Archived from the original on 14 February 2024. Retrieved 14 February 2024.
  28. ^ South, Todd (9 December 2020). "Congress cuts some funding for Army's cutting edge, do-it-all goggle". Army Times. Archived from the original on 4 April 2021. Retrieved 11 March 2021.
  29. ^ Roque, Ashley (11 March 2022). "Lawmakers call for IVAS procurement cuts, US Army weighing implications". Janes Information Services. Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  30. ^ Eversden, Andrew (11 March 2022). "Congress puts $349M for IVAS 'on hold,' but Army sees major boost to counter drones". Breaking Defense. Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  31. ^ Smith, Adam (13 October 2022). "Microsoft's smart goggles 'would have got us killed', army reportedly says". The Independent. Archived from the original on 5 December 2023. Retrieved 5 December 2023.
  32. ^ Ferran, Lee (22 April 2022). "Army could be 'wasting' $22B if soldiers don't like IVAS: Inspector General". Breaking Defense. Archived from the original on 22 April 2022. Retrieved 5 December 2023.
  33. ^ Shear, Frederick (14 March 2023). "IVAS' Campaign of Learning Ensures Development, Production and Fielding Remain on Track". U.S. Army. Archived from the original on 7 December 2023. Retrieved 6 December 2023.
[edit]
Retrieved from "https://en.wikipedia.org/w/index.php?title=Integrated_Visual_Augmentation_System&oldid=1218682547"