← BACK TO PROJECTS
XR IMMERSIVE & EXPERIENTIAL

VIRTUAL PRODUCTION WORKSHOP — AXIMMETRY & UNREAL ENGINE

SCALE Programme PENS × ITE Singapore (2024–2025)

ROLE //Virtual Production Instructor & System Operator
DATE //2024 – 2025
SCOPE //Green Screen Studio · Vive Mars CamTrack · Unreal Engine 5 & Aximmetry Live Compositing · PENS × ITE Singapore
VENUE //HCM Laboratory, 9th Floor Postgraduate Building, PENS
SCHEME //Offline
CONTROL ROOM BTS|FIELD PRODUCTION LOG
VIRTUAL PRODUCTION WORKSHOP — AXIMMETRY & UNREAL ENGINE
ON-AIRVIRTUAL PRODUCTION WORKSHOP — AXIMMETRY & UNREAL ENGINE
HCM Laboratory, 9th Floor Postgraduate Building, PENS

ABOUT THE PRODUCTION

A virtual production workshop conducted as part of the international SCALE Programme between Politeknik Elektronika Negeri Surabaya (PENS) and ITE Singapore in 2024 and 2025. Introduced participants to virtual production workflows using Unreal Engine, Aximmetry, and Vive Mars CamTrack in a calibrated green screen studio at the HCM Laboratory, PENS. Developed demonstration reference projects, instructed participants through technical presentations, and operated the virtual camera tracking and live compositing systems while guiding students to film cinematic music video scenes inspired by Disney’s Aladdin ("A Whole New World" and "Speechless").

TECHNOLOGY & RIG

Unreal Engine 5
Aximmetry
HTC Vive Mars CamTrack
Green Screen Studio
Real-Time Compositing
FreeD Protocol
Camera Tracking
Chroma Keying
COLLABORATION
INTERNATIONAL PROGRAM
PENS × ITE Singapore

SCALE Programme (2024–2025)

ROLE
DUAL CAPACITY
Instructor & Operator

Technical Teaching & Live VP

FACILITY
STUDIO ENVIRONMENT
HCM Laboratory

9th Floor Postgraduate Building, PENS

HARDWARE
CAMERA TRACKING
HTC Vive Mars CamTrack

Sub-mm Optical Telemetry

WORKSHOP BENCHMARKS & CAPABILITIES

2 Years
Consecutive SCALE Editions

Invited as lead instructor and system operator for both 2024 and 2025 cohorts.

Annual International Collaboration
Sub-mm
Optical Tracking Accuracy

HTC Vive Mars CamTrack sub-millimeter precision camera telemetry via FreeD protocol.

Multi-Sensor Genlock Sync
Real-Time
Zero-Latency Compositing

Simultaneous Unreal Engine 5 3D environment rendering & Aximmetry live keying.

Live Talent-to-Set Occlusion
2 Music Videos
Student Production Output

Directed and composited Aladdin-inspired productions ("A Whole New World" & "Speechless").

Hands-on Student Filmmaking

01 // PROGRAM OVERVIEW & INSTRUCTOR ROLE

Virtual Production Workshop with Aximmetry & Unreal Engine

SCALE Programme PENS × ITE Singapore (2024–2025) · HCM Laboratory, 9th Floor Postgraduate Building, PENS

A hands-on virtual production workshop conducted as part of the international SCALE Programme between Politeknik Elektronika Negeri Surabaya (PENS) and ITE Singapore in 2024 and 2025. The initiative introduced international students to state-of-the-art cinematic virtual production workflows combining Unreal Engine, Aximmetry, and Vive Mars CamTrack in a calibrated green screen studio at the HCM Laboratory, PENS.

INSTRUCTOR & OPERATOR RESPONSIBILITIES:I prepared and built real-time demonstration environments prior to the workshop, then delivered technical presentations explaining virtual camera tracking, genlock synchronization, and live compositing. Throughout the intensive practical sessions, I operated the virtual production suite—managing optical tracking, virtual lighting, and real-time camera feeds—while mentoring international student teams as they filmed music video scenes inspired by Disney’s Aladdin ("A Whole New World" and "Speechless").
WORKSHOP DETAILS //
Host UniversityPoliteknik Elektronika Negeri Surabaya (PENS)
Partner InstitutionITE Singapore
ProgramSCALE Programme
Timeline2024 – 2025 (2 Editions)
Studio SetupGreen Screen Studio & Optical Camera Tracking Rig
STUDENT CREATIVE OUTPUT
Disney's Aladdin Music Video Productions

Participants created cinematic scenes for "A Whole New World" and "Speechless", interacting live with virtual sets inside the green screen studio.

02 // CORE CONTRIBUTIONS & SYSTEM INTEGRATION

STEP 01

Virtual Production Project Development

Built real-time 3D reference scenes in Unreal Engine and configured interactive node graphs in Aximmetry.

STEP 02

Workshop Instruction & Technical Presentation

Delivered lectures and live demos explaining camera tracking theory, genlock sync, and real-time VFX pipelines to Singaporean and Indonesian students.

STEP 03

Green Screen Studio Setup

Engineered studio lighting balance, optimized green screen backdrop diffusion, and calibrated Vive base stations for optical tracking volume.

STEP 04

Vive Mars CamTrack Configuration

Calibrated camera sensor offsets, measured lens focal length distortion parameters, and routed FreeD UDP telemetry into Aximmetry.

STEP 05

Unreal Engine & Aximmetry Integration

Engineered seamless live communication between Unreal Engine 5 and Aximmetry, enabling real-time background and foreground layer rendering.

STEP 06

Real-Time Production Operation

Acted as primary system operator during live student takes, ensuring synchronized camera tracking, keying adjustments, and ISO recording.

STEP 07

Participant Production Guidance

Guided student directors, camera operators, and talent on blocking, eye-lines, and interactive physical-to-virtual prop alignment.

03 // VIRTUAL PRODUCTION WORKFLOW ARCHITECTURE

01STAGE

Optical Camera Tracking

Vive Mars CamTrack + FreeD Protocol

Sub-millimeter tracking rover attached to physical production cameras transmits positional and rotational telemetry (XYZ, Yaw/Pitch/Roll) at ultra-low latency over local Ethernet.

02STAGE

Real-Time 3D Rendering

Unreal Engine 5 (Nanite & Lumen)

Virtual environments dynamically respond to tracked camera movements, rendering photorealistic perspective shifts, dynamic shadows, and depth of field in real time.

03STAGE

Live Studio Compositing

Aximmetry Virtual Production Suite

Hardware video capture feeds and Unreal Engine render passes are composited with high-fidelity chroma keying, color grading, and talent shadow projection.

04STAGE

Student Music Video Production

Disney’s Aladdin ("A Whole New World" & "Speechless")

Participants applied theoretical knowledge to direct and film narrative scenes inside custom virtual sets, experiencing end-to-end studio filmmaking firsthand.

04 // VISUAL DOCUMENTATION REPOSITORY

ASSET STORAGE PATH:

public/images/projects/scale-vp-workshop/

Recommended photos: Green screen studio setup, Vive Mars optical tracking rover, Unreal Engine environments, workshop teaching sessions, and student Aladdin music video production takes.

READY FOR UPLOAD