Photogrammetry Use at Rockstar

Photogrammetry Use at Rockstar

Executive Summary

Photogrammetry, the science of deriving accurate three-dimensional measurements and textured geometry from sets of overlapping photographs, has become a foundational asset-creation pipeline in AAA game development over the past decade. This report examines photogrammetry's technical underpinnings, its watershed deployment by EA DICE on Star Wars Battlefront (2015), and the strong probability that Rockstar Games has applied similar techniques at scale to capture real-world Florida environments, foliage, props, and surface materials for Grand Theft Auto VI's fictional Leonida/Vice City setting. While Rockstar has not publicly detailed its photogrammetry workflow, evidence from prior titles (notably Red Dead Redemption 2), industry hiring patterns, and the visual fidelity demonstrated in published GTA VI trailers strongly suggests photogrammetry is now a core part of Rockstar's environment art pipeline.

1. Background: What Photogrammetry Is

Photogrammetry recovers 3D geometry by triangulating common feature points across many 2D photographs taken from differing positions, solving for camera intrinsics, extrinsics, and a dense point cloud through bundle adjustment, typically using a Levenberg–Marquardt optimisation (Wikipedia, 2025). The output is a textured mesh whose albedo, normal, and (when delighted) PBR material maps can be plugged directly into a modern renderer. Close-range photogrammetry — capture from metres rather than from aircraft — is the variant used in games and VFX, often combined with LiDAR or structured-light scanning for higher Z-axis accuracy (Wikipedia, 2025).

The attractiveness for games is twofold: photoreal results at a fraction of the hand-modelling cost, and ground-truth material response that responds correctly under any lighting scenario in a physically based renderer.

2. The Star Wars Battlefront Watershed (DICE, 2015)

EA DICE's 2015 Star Wars Battlefront is widely credited with bringing high-volume photogrammetry into mainstream AAA production. The DICE team travelled to original Star Wars filming locations — including the rainforests of Endor (Redwood National Park-equivalent forests), the volcanic landscape of Iceland used for Sullust, and the dunes of Tunisia for Tatooine — and captured thousands of reference photographs of rocks, bark, foliage, props, and original Lucasfilm Archives prop assets (EA DICE, 2015; Wikipedia, 2025).

Key technical aspects of DICE's pipeline included:

  • Capture rigs: DSLR cameras on tripods and turntables for studio props; handheld captures with colour-checker references for field assets.
  • Cross-polarised lighting: To remove specular highlights from raw photographs and recover an unlit "albedo" texture suitable for PBR shading.
  • Mesh decimation and retopology: Raw scans (often tens of millions of polygons) were reduced via tools such as Agisoft PhotoScan, ZBrush, and proprietary DICE software, then baked to game-ready meshes with normal, roughness, and ambient occlusion maps.
  • Material libraries: Scans fed a shared library re-used across levels, ensuring consistency between, for instance, the same lichen on a Sullust outcrop and an Endor stump (EA DICE, 2015).

The visual impact was substantial: critics widely described Battlefront as setting a new benchmark for environmental fidelity (80 Level, 2016). The approach was rapidly adopted by other studios — The Astronauts on The Vanishing of Ethan Carter, Naughty Dog on Uncharted 4, Ninja Theory on Hellblade: Senua's Sacrifice (which extended the technique to facial performance capture of actress Melina Juergens), and Guerrilla Games on Horizon Zero Dawn (Wikipedia, 2025).

3. Rockstar's Likely Adoption for Vice City / Leonida

3.1 Precedent in Red Dead Redemption 2

Although Rockstar publishes little about its internal toolchain, environment artists who have worked on Red Dead Redemption 2 have indicated on portfolios and conference talks that photogrammetry was used for rock formations, tree bark, and prop set-dressing in RDR2's varied biomes. The level of micro-surface variation visible across the game's deserts and forests is consistent with scan-based rather than purely hand-authored content.

3.2 Evidence for GTA VI

For Grand Theft Auto VI, set in a fictionalised southern Florida ("Leonida") encompassing Vice City (Miami), Port Gellhorn (Tampa-adjacent), and the Everglades-like wetlands, several factors point to extensive photogrammetry use:

  1. Trailer fidelity: The December 2023 and May 2025 trailers showed Art Deco façades, palm bark, wet asphalt, sand grains, and mangrove root systems with surface detail consistent with scan-derived assets.
  2. Hiring history: Rockstar job listings have for years sought environment artists with experience in Agisoft Metashape, RealityCapture, and Substance 3D Sampler — the standard photogrammetry-to-PBR toolchain.
  3. Scale economics: A map estimated at well over 100 km² with dense urban and natural biomes is economically impractical without scan-based asset libraries; manual authoring of unique foliage, rocks, and material variants at this scale would be prohibitive.
  4. Florida-specific assets: Plants such as saw palmetto, slash pine, sabal palm, and mangrove require species-accurate models; field photogrammetry trips to South Florida are the most efficient way to obtain them, mirroring DICE's location captures.

3.3 Probable Pipeline

A plausible Rockstar pipeline, by analogy to DICE and inferred from public artist resources, would involve: field capture with DSLR/mirrorless rigs and reference colour charts; cross-polarisation for foliage and stone; reconstruction in RealityCapture; cleanup and retopology in ZBrush and Houdini; delighting and PBR material extraction in Substance Sampler/Designer; and integration into RAGE engine asset databases with LOD chains and procedural scattering via in-house tools comparable to Houdini or SpeedTree.

4. Limitations and Hybrid Approaches

Photogrammetry is not a panacea. Reflective, transparent, fine-detail (hair, leaves backlit) and moving subjects all defeat naive capture, requiring spray-matting, polarisation, or hybrid sculpting (Wikipedia, 2025). For characters and vehicles, Rockstar likely uses photogrammetry only for reference and head/clothing scans, with hand-authored topology for animation-ready meshes. Vehicles in particular are typically modelled from CAD or blueprints, with photogrammetry contributing only weathering and material variants.

5. Conclusion

Photogrammetry transitioned from research curiosity to mainstream AAA pipeline largely on the strength of DICE's 2015 Star Wars Battlefront demonstration. A decade later, every major open-world studio relies on it in some form. Rockstar, despite its institutional silence, has both the precedent (RDR2), the tooling evidence (hiring), and the scale incentive (Leonida/Vice City) to be using photogrammetry as a primary environment-asset source for GTA VI. The fidelity gap between the franchise's prior entries and what has been shown of GTA VI is consistent with this shift in pipeline rather than purely with raw hardware uplift.

References

EA DICE (2015) How we used Photogrammetry to Capture Every Last Detail for Star Wars Battlefront. Available at: http://starwars.ea.com/starwars/battlefront/news/how-we-used-photogrammetry (Accessed: 14 May 2026).

80 Level (2016) Photogrammetry in Games: An Overview. Available at: https://80.lv/articles/photogrammetry-in-games-an-overview/ (Accessed: 14 May 2026).

Wikipedia (2025) Photogrammetry. Available at: https://en.wikipedia.org/wiki/Photogrammetry (Accessed: 14 May 2026).

Statham, N. (2018) 'Use of Photogrammetry in Video Games: A Historical Overview', Games and Culture, 15(3), pp. 289–307. doi:10.1177/1555412018786415.

Poznanski, A. (2014) Visual Revolution of The Vanishing of Ethan Carter. The Astronauts. Available at: http://www.theastronauts.com/2014/03/visual-revolution-vanishing-ethan-carter/ (Accessed: 14 May 2026).