Create A Virtual Mouse Using 35 Lines of python || Python Project || AI Powered Mouse || open cv

Introduction

In this tutorial, we will learn how to create a virtual mouse using Python. By leveraging libraries like OpenCV, MediaPipe, and PyAutoGUI, you will be able to control your computer simply by moving your finger. This project is both fun and practical, demonstrating the power of computer vision and hand tracking.

Step 1: Install Required Packages

Before we start coding, we need to install the necessary libraries. You will need:

• OpenCV
• MediaPipe
• PyAutoGUI

Installation Commands

1. Open your terminal or command prompt.
2. Run the following commands:

   pip install opencv-python
   pip install mediapipe
   pip install pyautogui
   

Step 2: Open Video Camera

Next, we will set up the video camera to capture your hand movements.

Implementation

1. Import the necessary libraries in your Python script:

   import cv2
   import mediapipe as mp
   import pyautogui
   

2. Initialize the video capture:

   cap = cv2.VideoCapture(0)
   

Practical Advice

• Ensure your camera is functioning properly.
• Test the camera feed by displaying it using OpenCV's imshow function.

Step 3: Detect the Hand

Now, we will use MediaPipe to detect your hand in the video feed.

Implementation

1. Set up the MediaPipe hands model:

   mp_hands = mp.solutions.hands
   hands = mp_hands.Hands()
   

2. Inside the loop where you read frames from the camera, process the frames:

   success, image = cap.read()
   image_rgb = cv2.cvtColor(image, cv2.COLOR_BGR2RGB)
   results = hands.process(image_rgb)
   

Troubleshooting

• If you encounter errors with MediaPipe, ensure you are using protobuf package version 3.20.x or lower. You can install it with:

  pip install protobuf==3.20.*
  

Step 4: Separate the Index Finger

To use your index finger as a mouse pointer, we need to identify its landmark.

Implementation

1. Check if any hands are detected:

   if results.multi_hand_landmarks:
       for hand_landmarks in results.multi_hand_landmarks:
           index_finger = hand_landmarks.landmark[8]  # Landmark for index finger
   

2. Get the coordinates of the index finger:

   h, w, _ = image.shape
   x = int(index_finger.x * w)
   y = int(index_finger.y * h)
   

Step 5: Move the Mouse Pointer

Now that we have the index finger's position, we can move the mouse pointer accordingly.

Implementation

1. Use PyAutoGUI to move the mouse:

   pyautogui.moveTo(x, y)
   

Practical Tips

• Adjust the sensitivity of the mouse movement by scaling the x and y coordinates if necessary.

Step 6: Implement Click Operation

Finally, we will enable clicking functionality based on your hand gestures.

Implementation

1. Detect whether the index finger is pointed downwards or lifted.
2. If it's down, simulate a mouse click:

   if index_finger_is_down:
       pyautogui.click()
   

Conclusion

In this tutorial, you've learned how to create a virtual mouse using Python and OpenCV. You can now control your computer with simple hand movements, making it a fun and interactive project.

Next Steps

• Experiment with additional gestures for right-click or scrolling.
• Explore other computer vision projects using OpenCV and MediaPipe.

For the complete code, you can visit the GitHub repository.