The TRUTH About ChatGPT's Lyric Writing Capabilities: Evaluation of ChatGPT's Lyric Writing Skills

Have you ever wondered if you could outsource your lyric writing to a language model like ChatGPT? In this article, we'll explore the possibilities and limitations of ChatGPT in the realm of songwriting.

To begin, let's see what ChatGPT can do when it's given the following prompt: "write me some song lyrics in the style of early 2000s goo goo dolls" 

The Results: 

Verse 1:

Lost in the city lights

I'm searching for a sign tonight

Every road just leads to dead ends

I'm trying to find my way back again

Chorus:

In this world that's moving fast

I just want to make it last

And find my way to where I belong

In this heart that beats so strong

Verse 2:

Memories fade and dreams come true

I'm holding on to something new

Every step I take is getting closer

To a brighter future, to a world that's kinder

Chorus:

In this world that's moving fast

I just want to make it last

And find my way to where I belong

In this heart that beats so strong

Bridge:

In the dark, I'll shine a light

To guide me through the night

I'll keep moving, keep believing

And find the strength to keep on breathing

Chorus:

In this world that's moving fast

I just want to make it last

And find my way to where I belong

In this heart that beats so strong

Outro:

So I'll keep moving on and on

With my heart that beats so strong

And I'll find my way to where I belong

In this world that keeps moving on.

Going off of that test, it seems that while ChatGPT can come up with some ideas, it's not quite on par with the skills of a human lyricist. The resulting lyrics were workable, but lacked originality and often featured cringe-worthy rhymes.

Let's try again, this time with this more specific prompt: "write me song lyrics about losing a lover by the ocean in the style of breaking benjamin"

The Results:

Verse 1:

By the ocean, we stood so strong

But now you're gone and I'm here all alone

The waves crash against the shore

As I drown in memories that I can't ignore

Chorus:

Lost in the sea of my own despair

Wishing you were still here

My heart is breaking as I stand here

By the ocean, without you near

Verse 2:

I try to escape from the pain

But every moment just brings me back again

To the place where we used to be

Where love was real and you were next to me

Chorus:

Lost in the sea of my own despair

Wishing you were still here

My heart is breaking as I stand here

By the ocean, without you near

Bridge:

I've lost my compass, I'm adrift at sea

Hoping you'll come back to rescue me

But every time I close my eyes

I'm just lost in the tides

Chorus:

Lost in the sea of my own despair

Wishing you were still here

My heart is breaking as I stand here

By the ocean, without you near

Outro:

And now I'm left with just the waves

As they wash away all my mistakes

And I'm standing here all alone

By the ocean, without you home.

I'd say these results are slightly better, but still far from impressive. ChatGPT really does seem to have a tendency to over-rhyme, making the lyrics come across as corny and forced. It's important to note that song lyrics don't always need to rhyme, and it's almost always better to make sure the meter is perfect and the words communicate exactly what you want them to than to force unnatural rhymes. 

So, what's the verdict? Can ChatGPT replace human lyricists? Based on these tests, I'd argue that the answer is a resounding no. While ChatGPT can provide some inspiration and a starting point, it's not capable of producing lyrics that are up to par with a decent human lyricist. However, it could potentially be used as a tool to create initial lyrics that we then apply iterative lyric editing to, where the AI generates a first draft and the human lyricist takes it from there.

In conclusion, while ChatGPT has its limitations, it could still be a useful tool for songwriters looking to generate ideas or jumpstart their creative process.