SHFLA (Shoegaze Hierarchical Fractal Language Architecture) bridges music and visuals by dynamically generating stunning Julia set fractals that respond to the nuances of any song. By mapping musical features to fractal parameters, it offers an immersive experience that transcends conventional computing, showcasing a harmonious blend of art and technology.
SHFLA (Shoegaze Hierarchical Fractal Language Architecture) is an innovative interdisciplinary project that merges concepts from Cognitive Musicology, Linguistics, Music Theory, and Computer Science to create a captivating auditory and visual experience. By leveraging a dynamic system represented as a fractal, SHFLA continuously adapts to musical excerpts provided by the user. The application interprets sounds into sequences of stunning visual imagery, specifically generating real-time Julia set fractals that synchronize beautifully with the audio being played.
Key Features
- Real-Time Music Visualization: Effortlessly generate dynamic Julia set fractals that are in sync with any song.
- Feature Mapping:
- Brightness corresponds to the spectral centroid of the music, providing a visually engaging experience.
- Contrast is linked with the complexity of the Fourier transform, allowing for intricate visual patterns.
- Color is determined by the musical key, which is translated into an RGB color palette for vibrant displays.
- Edge Smoothness and Complexity depict consonance and dissonance for a deeper narrative interpretation of the sound.
- Sphericality reflects the resonance of the audio, enhancing the immersive experience.
- Asymmetry indicates panning, showcasing a stereo balance in the music.
- Interactive User Experience: The program automatically retrieves song audio and album art based on the user's input, making the setup seamless and engaging.
- Exploration of Turing Completeness: This project not only provides beautiful visuals but also demonstrates the potential for Turing-complete computation through sound-based prompts and fractal generation.
How It Works
- Audio Input: Users input their song choice, allowing the program to fetch audio data from YouTube.
- Feature Extraction: The program processes audio to gather pitch, spectral centroid, and panning data, which serve as parameters for fractal generation.
- Fractal Generation: Utilizing real-time audio data, SHFLA produces a continuously evolving Julia set fractal, updated according to the extracted features.
- Visualization: The final visual output is seamlessly displayed using Pygame while remaining in sync with the music playback.
Usage Example
To visualize any song, simply run the program and follow prompts to enter a song name:
python main.py
You can specify your desired resolution or use the default resolution of 1920×1080.
Community and Contributions
SHFLA encourages contributions and insights from creators and developers alike. Join the movement towards integrating art with technology by participating in feature developments and enhancements!
Experience a unique audiovisual journey that not only entertains but also offers deep insights into the interplay of music and visual representation. Get started with SHFLA today for a mesmerizing blend of art and technology!