Hybrid Desktop Automation Using Selenium and PyAutoGUI

Author(s)	Ravi Kumar Mohane, Prof. Arun Jhapate
Country	India
Abstract	This paper proposes a hybrid automation framework that integrates Selenium and PyAutoGUI to automate desktop applications, specifically demonstrated through the Telegram Desktop application. Traditional desktop automation tools often lack flexibility and robustness when dealing with modern, dynamic user interfaces. The proposed hybrid approach overcomes these limitations by combining Selenium's web automation strengths with PyAutoGUI's GUI interaction capabilities. Furthermore, the system integrates voice-based OTP (One-Time Password) entry using Google Speech-to-Text, enhancing usability through hands-free interaction. Additional features include logging mechanisms for traceability and automated screenshot capturing for debugging and reporting. The framework demonstrates improved automation efficiency, reduced scripting complexity, and extensibility for future scalability. This hybrid model provides a promising direction for intelligent, cross-platform desktop automation.
Keywords	Desktop Automation”, “Hybrid Framework” , “Selenium”, “ PyAutoGUI” , “ Voice Recognition” , “Telegram Automation”, “Speech-to-Text
Field	Engineering
Published In	Volume 16, Issue 3, July-September 2025
Published On	2025-07-22
DOI	https://doi.org/10.71097/IJSAT.v16.i3.7174
Short DOI	https://doi.org/g9t2xw

About IJSAT Fees & Payment Current Issue Publication Archive	Submit Research Paper Track Submission Status Publication Guidelines Publication Ethics Peer Review & Plagiarism	Join as a Reviewer Editors & Reviewers Reviewer Referral Program Get Reviewer Membership Certi.	Website/Journal Policies Usage Policy Content Policies Privacy Policy

Contact Us	Message on WhatsApp	+91-9687-182-185	editor@ijsat.org

International Journal on Science and Technology