Research Prototype
AI-Powered Voice Interaction in Virtual Reality
Natural-Language 3D Object Manipulation
This project explores natural-language interaction for manipulating virtual objects in real time. A user speaks naturally through a Meta Quest headset, and the system interprets the command using artificial intelligence before applying the requested changes inside Unity.
Unlike fixed voice-command systems, the prototype supports flexible expressions such as “make it slightly narrower,” “turn it into a dark-purple cylinder,” or “rotate it 30 degrees and move it closer.”
Automatic Voice Input
Detects speech automatically and waits until the user completes the command.
Natural-Language AI
Converts unrestricted spoken instructions into structured object-manipulation actions.
3D Manipulation
Changes object color, shape, dimensions, scale, rotation, and position.
Meta Quest Deployment
Runs as a standalone Android VR application on Meta Quest 3S.
Current Capabilities
- Automatic speech and silence detection
- Unrestricted color descriptions converted to HEX values
- Cube, sphere, cylinder, and capsule transformation
- Width, height, and depth manipulation
- Relative and angle-based rotation
- Left, right, up, down, closer, and farther movement
- Multiple actions from a single spoken sentence
- Duplicate-command protection and full object reset
Example Voice Commands
“Make it a tall dark-purple cylinder.”
“Make it slightly less wide.”
“Rotate it 45 degrees to the right.”
“Move it closer and make it ocean blue.”
“Reset everything.”
System Architecture
Meta Quest Microphone
Unity C#
Python Flask Server
Speech-to-Text + LLM
Structured JSON
VR Object Update
Prototype Demonstration
Research Focus
The prototype supports research on whether conversational voice interaction can provide a more natural and efficient alternative to controller-based object manipulation in immersive environments.
Potential Evaluation Metrics
- Task completion time
- Command interpretation accuracy
- Number of correction attempts
- User effort and cognitive workload
- Perceived usability and naturalness
Technologies: Unity, Meta Quest 3S, C#, Python, Flask, OpenAI API, TextMeshPro, XR Interaction Toolkit
Timeline
Education
-
University of Arkansas at Little Rock, AR, USA
Doctor of Philosophy in Computer and Information Science Aug 2026 - PresentAug 2026 - Present -
University of Arkansas at Little Rock, AR, USA
Master of Science in Information Science Aug 2024 - May 2026Aug 2024 - May 2026 -
University of Dhaka, Dhaka
Master of Arts in Information Science and Library Management. CGPA-3.44/4 Dec 2022 - Dec 2023Dec 2022 - Dec 2023 -
University of Dhaka, Dhaka
Bachelor of Arts in Information Science & Library Management. CGPA-3.34/4 Jan 2018 - Nov 2022Jan 2018 - Nov 2022 -
Munshirhat Islamia Senior Alim Madrasah, Cumilla
Higher Secondary Certificate. GPA-4.79/5 Jun 2015 - Jul 2017Jun 2015 - Jul 2017 -
Munshirhat Islamia Senior Alim Madrasah, Cumilla
Secondary School Certificate. GPA-5.00/5 Jan 2013 - May 2015Jan 2013 - May 2015
Timeline
Professional Experience
-
Graduate Teaching Assistant
University of Arkansas at Little Rock, AR- 72204, USA Sep 2024 - May 2026Sep 2024 - May 2026As a Graduate Teaching Assistant at the University of Arkansas at Little Rock, I supported students in web design and development courses through classroom assistance, lab sessions, and individualized guidance. I helped students understand technical concepts and troubleshoot issues related to web development.
I also evaluated assignments and projects, provided constructive feedback, and assisted with course activities to support student learning and maintain academic and technical standards.
-
Graduate Research Assistant
University of Arkansas at Little Rock, AR- 72204, USA May 2025 - December 2025May 2025 - December 2025As a Graduate Research Assistant on the Data Washing Machine (DWM) project, I conducted research on entity resolution and data quality evaluation. My work included running DWM modules, tuning parameters, analyzing internal metrics, and documenting experimental results.
I also assisted with experiment design, debugging, performance evaluation, and research reporting to support the development of scalable and unsupervised data integration solutions.
-
Web Developer
Innova IT Institute, Karwan Bazar, Dhaka-1215 Dec 2021 - Jul 2024Dec 2021 - Jul 2024I specialize in examining organizational frameworks, creating database structures, strategizing web functionalities to harmonize with organizational objectives. I concentrate on compiling additional features and products that go beyond the primary requirements.
Following the system design phase, I actively engaged in the development of the web application, utilizing PHP, Laravel, JavaScript, and React.js. Additionally, I extend support to clients by implementing their post-service requirements and addressing any website bugs that may arise during the production stage. Explore the projects I have successfully completed in the Projects Module.
-
Internship on “Information Science & Library Management”
Bangladesh National Scientific Technical Documentation Center, Dhaka-1207 Jan 2021 - Feb 2021Jan 2021 - Feb 2021I compiled documents for exhibitions, managed journal papers, and research articles. I gained exposure to the governmental organization's strategy and policy, and underwent hands-on training in the departmental regulations of BANSDOC.
Projects
Web Development
-
- Custom Query Builder for Data Filtering
- Interactive Charts and Dashboard Visualization
- Dataset Summary and Data Insights
-
- OMR System Integration
- Admission Procedures
- Class and Routine management
-
- News Upload and Management
- Archive Management
- Large Traffic Handling
-
- Self Selected Online Exam
- Student Management
- Free and Premium Assessment Platform
-
- Book Publication
- Book Printing Maagement
-
- Student’s Result Management
- Result Tabulation
- Live Class integration
-
- Online Course Management
- Student Management
- Purchase Management
-
- Tuition Management
- Guardian Management
- Tutor Management
-
- Learning Materials Management
- SMS Management
- Article Management
-
- Daily Diary Management
- Monthly Report of Individual
- Yearly Report of Individual
-
- Skill-Based Course Management
- Donation
- Multi-Payment Gateway
-
- Academic Board Management
- Exam Center and Group Module
- Board Result Processing
Skill
Technical Skills
Programming Language
-
PHP
-
C++
-
SQL
-
Python
Web Design
-
HTML
-
CSS3
-
Bootstrap
-
Jquery
-
JavaScript
-
React.js
Web Server
Databases
Data Visualization Tool
-
Excel
-
Tableau
Others
I am a Ph.D. student in Computer and Information Science at the University of Arkansas at Little Rock, where I also completed my Master of Science in Information Science. My academic and research interests include Human-Computer Interaction, Virtual Reality, Artificial Intelligence, data visualization, and intelligent interactive systems.
My current research work explores AI-powered natural-language interaction in Virtual Reality. I am developing a Meta Quest prototype that allows users to manipulate virtual objects using conversational voice commands. The system integrates Unity, C#, Python, Flask, and AI-based language processing to translate spoken instructions into real-time actions in immersive environments. I am particularly interested in usability, interaction efficiency, cognitive workload, command ambiguity, and user control in voice-based VR systems.
Alongside my research experience, I have a strong background in software and web application development. Before beginning my graduate studies in the United States, I worked as a Web Developer at Innova IT Institute in Dhaka, where I contributed to the design and development of production web applications using PHP, Laravel, JavaScript, React.js, databases, and cloud technologies. I have also served as a Graduate Teaching Assistant and Graduate Research Assistant at UA Little Rock, gaining experience in teaching, research experimentation, data analysis, and technical problem-solving.
My long-term goal is to conduct research at the intersection of AI, immersive technologies, and Human-Computer Interaction, with an emphasis on developing intelligent systems that make interaction with technology more natural, accessible, and effective.