Pitch

Description

Comments

About this project

Desktop Fly is a minimal application that brings to life the neuronal activity of a fruit fly while it glides across your screen. Utilizing OpenGL, the app visualizes neuron data from the Male CNS dataset, allowing users to explore the fly's responses to its environment through streaming desktop activity.

Desktop Fly

A minimal desktop application for visualizing a fly flying over your desktop and its neuron data using OpenGL. The fly "thinks" in terms of its neuron activity as we stream desktop screenshots and mouse movements into the neural network. The neuron data is taken from male-cns:v1.0 for a male Drosophila (fruit fly) central nervous system 🪰

I didn't use the whole dataset, only a few neuron types:

DNge104 - Descending neuron, for the motor control
KC - Kenyon cell, for the mushroom body and learning processes
HBeyelet - Horizontal system B eyelet, for the visual system
TTMn - Tergotrochanteral motor neuron, for the leg movement

Features

Visualize a fly flying over your desktop using OpenGL.
Visualize fly neuron data using OpenGL.
Minimal and lightweight desktop application.
Cross-platform support (Windows, macOS, Linux).

Installation

Download the latest release from the releases page for your operating system.
Extract the downloaded archive to a desired location.
Navigate to the extracted directory and run the application 🤝

NOTE: On macOS, you may need to allow the application to run from the Security & Privacy settings if it is blocked by Gatekeeper.

Development

Prerequisites

Go (https://golang.org/dl/)
Python (https://www.python.org/downloads/)
OpenGL (https://www.opengl.org/) [Usually comes pre-installed on most systems]

Installation

git clone https://github.com/freaker2k7/desktop-fly.git
cd desktop-fly
pip install -r requirements.txt

Create Dataset

python scripts/get_neurons.py --root DNge104
python scripts/get_neurons.py --root KC
python scripts/get_neurons.py --root HBeyelet
python scripts/get_neurons.py --root TTMn

Build and Run

go build
go test
./desktop-fly

License

This project is licensed under the MIT License - see the LICENSE file for details.