top of page

Introduction

"Hip-hop is unique – an art form that seized upon existing technology and warped its use into a new art form.  This new genre drove technological innovation, enabling further musical creativity and driving more innovation in a cycle that continues today."

​

- multi-GRAMMY®-winning producer, engineer, artist and educator Prince Charles Alexander

            In 2020, hip-hop is the most prominent genre in the United States and, statistically speaking, the most popular. Over the past nearly half century it has evolved from a local New York City phenomenon to a ubiquitous organism of music and culture that has been called “America’s musical export” to the world. While modern hip-hop has swiftly evolved and grown far from its roots, the history still impacts today’s sound and culture and has influenced numerous other genres along the way both in the United States and internationally. While countless factors built the early microcosm of hip-hop, one ingredient was arguably the most vital – even long before it had a common name – and that was the “break”. 

            Breaks can be referred to interchangeably as “breakbeats, break beats or breakdowns,” but all these terms essentially refer to the same fundamental aspect of hip-hop and its production. A break is an instrumental or percussive section of a song traditionally derived from or related to down-time – being a “break” from the main parts of the song or piece. It is generally the part of a track with minimal instrumentation and no (or minimal) lyrics. A breakbeat refers to the sampling or reuse of breaks as drum loops and their subsequent use as the rhythmic basis for hip-hop and rap. 

            For many, sampling has shifted from analog (vinyl) to digital, opening the door for vast amounts of music and audio across the internet. While this art of sampling has evolved from digging through record crates to digging through unfathomable bits of musical data, the listener, DJ, or the producer still has to sift through hours and hours of music sometimes to find a suitable sample or break. However, with the advent of virtual intelligence systems, the methods of sifting can continue to evolve and maximize in efficiency. I have proposed and developed a neural network for this task to quickly and systematically sort through immense libraries of music for the purpose of automatically classifying suitable portions of songs that fit the classification of breaks. Paired with an additional utilization tool, this network facilitates extracting samples and creating hip-hop beats more easily and rapidly than ever before. 

            In doing so, a small library of breaks and their respective original songs was utilized to train a deep learning network to analyze the spectral images of these given audio clips with respect to frequency over time. This modified convolutional neural network (CNN), named the Perceptron Audio Classifier (PAC), returned a recognition and proper differentiation rate of 98.89% with loss factors as low as 2.49%. The results of this CNN were then used as the basis for what I call the Break Identification Genius (BIG), a utilization tool designed to analyze entire songs by systematically segmenting them into bars according to a BPM (beats per minute) analysis and an onset detection algorithm using Google Colab. Essentially, entire songs were segmented, and the PAC model was utilized by BIG to determine whether every single section was considered a suitable break or not. Once a suitable break was found, these bars of the songs could be extracted and easily looped to create a new beat for hip-hop. Together these methods are the basis for the Break Boss concept, an automated breakbeat finder and inspirational tool.

            

How It Works

            The Break Boss works by utilizing two sub-systems called PAC & BIG. PAC is a unique convolutional neural network using a residual recursion architecture based on a ResNet34 structure. As the name suggests, a neural network is a system in which points of comparison work like nodes in the brain and are interconnected to other nodes. This means that PAC is capable of learning how to find breaks and even fine-tuning its learning patterns using thousands of means of comparison between various nodes. To facilitate the arduous process of processing audio, PAC first converts breaks into sectioned Spectrogram images that display frequency over time with relation to intensity. In other words, you can visually see how loud certain frequencies are using a color spectrum in a given segment of a song.

Unknown-3.png

            By converting audio into a visual representation, PAC is able to quickly compare song elements and identify breaks and non-breaks based on how they "look." After minor training, PAC can determine whether a given segment of audio is a relatively suitable break or not with approximately 98.89% accuracy. In summary, PAC is an intelligent system of classifying breaks in any audio source that is given.

            On the other hand, BIG is a tool for making use of this classification process. BIG works by taking in new sample songs and systematically analyzing them to identify where breaks occur. In other words, if you give BIG a song, it can suggest where a break occurs based on the classification algorithms used in PAC. It does so by segmenting the input song based on BPM analysis and onset detection tools to roughly determine bars. BIG then analyzes each section to give back potential breaks.

Unknown-1 copy.png
Unknown-1.png
Screen Shot 2020-08-06 at 21.14.26.png
Screen Shot 2020-08-06 at 21.17.15.png

The following playlist is a series of breakbeat loops found by PAC+BIG working in tandem that were looped in Ableton Live 10. Some you may know, and some may be new to you. Feel free to be inspired!

            While this brief description gives the high-level workings of Break Boss, there is so much more to the program. For more information about how the project functions, read more in the original dissertation paper in the link below.

bottom of page