DM.
Selected project · Python · Telegram

Remote game control and monitoring through Telegram

An asynchronous desktop companion for Sky: Children of the Light. It connects a Telegram interface with a Windows game client, making selected controls, screenshots, chat and progress information available from a phone.

PythonTelethon / MTProtoOpenCV + Tesseract OCRasyncioWindows automation

What it does

Remote controls

Sends selected keyboard actions from Telegram to the running game, including movement and common in-game actions.

Screen and chat monitoring

Captures screenshots on request, reads visible chat text from the screen, and relays updates to Telegram.

Smart Start

Automates a startup routine: launches the game through Steam, waits for it to load, moves through the start flow, and collects initial stats.

Progress tracking

Recognizes the visible candle balance and estimates daily earnings while accounting for server reset timing.

Multi-user administration

Uses JSON-based roles and an admin panel to manage access, personal greetings and activity logs.

Cleaner Telegram UI

Uses inline buttons for controls and removes older bot messages to keep the active chat easier to use.

How it works

01 · StartRun the Python companion on the Windows PC.
02 · ConnectOpen the Telegram bot from a phone or desktop.
03 · RequestChoose a control or monitoring action in Telegram.
04 · RespondThe local script performs the action and returns relevant screen information.

The project reads the game through captured screen images and sends simulated keyboard/mouse input. Its design does not depend on reading the game’s internal memory.

Technical approach

Computer vision and OCR

OpenCV and Tesseract OCR extract visible chat and balance text. Image preprocessing—such as scaling, binarization and noise filtering—helps make recognition more reliable.

Concurrent tasks

asyncio keeps background work, such as chat monitoring, running without blocking the Telegram control interface.

Desktop interaction

Uses Windows automation libraries to capture the screen and send game controls from the local computer.

State and access

Stores lightweight user roles and activity data in JSON, with Telegram-side administration for access management.

Development: v0.1 to v1.3

v0.1.0 · Early working build

The console log shows the first Smart Start and candle tracking features active, with Telegram commands and admin actions being exercised.

v0.2–v1.2 · Iterative development

A series of versions developed the project into a broader remote-control and monitoring tool, refining its controls, screen analysis, chat handling and user management.

v1.3 · Latest version

The most up-to-date release in the project’s development history.

The intermediate release notes are not listed individually here; the version range reflects the project history provided by the author.

Project screenshots

Tools used

Python · Telethon · OpenCV · Tesseract OCR / pytesseract · NumPy · asyncio · pyautogui · pydirectinput · pygetwindow · pyperclip · JSON

Discuss this project ↗ Back to portfolio