We introduced the concept of applying Natural User Interface
(NUI) interactions in the context of Integrated Development
Environments (IDEs). We developed a prototype tool
and conducted a pilot study to assess its feasibility. Despite
the challenges and current limitations, we believe that it has
the potential to improve development, tool discoverability,
and ease of use. To make the tool more reliable and applicable,
we have set forth the following goals:
1. Implement a more reliable speech recognition mechanism
that would allow for localization.
2. Integrate learning capabilities that would allow the
system to adapt to the user’s pronunciation and gesture
speed.
3. Extend the system beyond Visual Studio, on a variety
of operating systems.
More details on the project, including video demonstrations,
are available on the Wichita State University Software Engineering
Research Lab website2
.