AI vs Human programming

+ TikTok adds AI chatbot

Mindstream Banner


Coffee was most likely discovered in Yemen during the 15th century in Sufi Muslim monasteries, spreading from there throughout the Middle East and Northern Africa​, and eventually taking over the world.

Love or hate this intro? Hit reply and tell us why!

What’s in store:

  • Can AI code better than us?

  • TikTok has its own chatbot, and it’s called Genie.

  • Around the web: Apple Watch Series 10 may feature a larger screen, thinner case, and new AI-enhancing chip.

  • QueryPal makes customer service simple.

Read Time: 6 minutes


How good is AI at writing code, really?

For decades, programmers have been crafting code for AI models.

Thanks to AI, the roles are reversed - AI is coding for us.

So, how does AI-generated code stack up against human programmers?

A study in IEEE Transactions on Software Engineering examined the code produced by OpenAI’s ChatGPT, focusing on functionality, complexity, and security.

ChatGPT's success rates varied widely, from a low of 0.66% to a high of 89%, depending on the task's complexity, programming language, and other factors.

The study revealed both advantages and concerns. While AI can enhance productivity and automate tasks, there are notable security risks with AI-generated code.

Yutian Tang, a lecturer at the University of Glasgow, highlighted the need to understand both the strengths and limitations of AI code generation.

What you should know:

  • AI can boost productivity but has security risks.

  • ChatGPT excels at older coding problems but struggles with newer ones.

  • Providing AI with detailed instructions can improve code quality.

To go deeper, Tang's team tested GPT-3.5 on 728 coding problems from LeetCode across five languages: C, C++, Java, JavaScript, and Python.

Results showed that while ChatGPT could generate functional code for pre-2021 problems, its performance dropped significantly for newer issues.

Some stats to keep in mind:

  • Pre-2021 problems: Success rates of 89% (easy), 71% (medium), and 40% (hard).

  • Post-2021 problems: Success rates dropped to 52% (easy) and 0.66% (hard).

The good, the bad, and the buggy

The research underscores the importance of providing AI with additional context and feedback to improve code quality and reduce vulnerabilities.

ChatGPT was fairly good at solving problems in different coding languages, especially those existing on LeetCode before 2021.

For example, it produced functional code for easy, medium, and hard problems with success rates of about 89%, 71%, and 40%, respectively.

However, ChatGPT's ability to generate correct code for newer problems dropped significantly.

It sometimes failed to understand the meaning of questions, even for easy problems.

This is likely because ChatGPT is better at addressing issues it has encountered before and lacks the critical thinking skills of a human.

Overall, developers using ChatGPT should provide additional information to help the AI understand problems better and avoid vulnerabilities.

By understanding these nuances, developers can better leverage AI tools like ChatGPT in their workflows.

Programmers, your job is safe - but for how long?

Would you be okay with AI writing your code?

Login or Subscribe to participate in polls.

Vote for live results and see results + opinions from yesterday at the bottom of the email.


Boost Customer Satisfaction with an AI-Trained Helpdesk

Launch an AI agent trained on your company documents, websites and apps in minutes. Resolve support requests and sell more, faster.

Seamlessly integrating with Google Drive, Notion, Confluence, and more. QueryPal is easily customizable and secure.

On This Day

July 8th 1947 - Reports are broadcast that a UFO crash landed in Roswell, New Mexico in what became known as the Roswell UFO incident.

Trending Tools

PodSnacks Inc*: Too many podcasts, too little time? Get AI-generated summaries of your favourite podcasts in your inbox, for free. Subscribe to PodSnacks!

Hello History: An AI tool that lets you chat with iconic historical personalities, offering a unique and interactive learning experience that brings history to life in an engaging manner. This AI character generator allows users to create animated video stories by designing unique scenes and characters, fostering creativity without the need for technical skills.

Replika: An AI companion that provides personalised interaction, learning over time from user interactions. This tool is designed to be a friend, partner, or mentor, available 24/7 for chats or advice.

Crypko: This tool focuses on creating highly customisable anime-style characters, offering features like smooth animations, which make it ideal for anime fans and creators who want to design their own characters.


TikTok is introducing "Genie," an AI chatbot aimed at upgrading user interaction and functionality for Western audiences.

Genie will provide more than just Q&A - users can engage within video streams, getting real-time assistance and new interactive features.

Here’s what Genie will do:

  • Real-time assistance in video streams.

  • Integration of AI technologies like virtual live-streamers and the "StreamVoice" system.

  • Enhanced user engagement, offering creative tools within chat interactions.

A leap in user interaction

This move follows TikTok’s earlier chatbot, "Tako," trialled in the Philippines. Genie will incorporate TikTok’s advanced generative AI, similar to Douyin’s (China’s TikTok).

TikTok hopes to transform the user experience with AI, making it more engaging and interactive.

Does it bring back videos I watched, but then can never find again?

Mindstream Picks

The upcoming MMORPG Ashes of Creation features a dynamic world that changes with players' actions, supported by the studio's unique Intrepid Net and special "server meshing" technology.

European stocks slipped and the euro weakened after France's snap election result raised concerns about the country's finances.

Notcoin surged 50% in the past 24 hours, capturing the attention of investors and sparking lively discussions online.

A Russian satellite likely experienced a "low-intensity explosion," creating hundreds of debris pieces in low Earth orbit, according to an analysis. Both U.S.

Don’t Miss - The Apple Watch Series 10 may feature a larger screen similar to the 49mm Apple Watch Ultra, a thinner case, and a new chip with potential AI enhancements. Despite challenges with new health sensors, Apple plans a cheaper Watch SE with a plastic case and an updated Watch Ultra 3.

AI Art

Our Image of the Day

Artwork submitted by Mindstream reader Kort K: “Hovering cars in a neon-lit city”

Daily Image Prompt

A high-tech library with floating books

Yesterday’s Poll

“Do you think AI will finally keep online trolls in check?”

No, trolls will always find a way. - 54%

Yes, it’s about time! - 46%

Your Views:

“The AI will be biased by whoever holds the reins and the line between safety and censorship will vary wildly.” - tedkeith

“Trolls depend on anonymity, AI can deprive them of that, when they are exposed they’ll go back into the slime pits they came from” - wendy

Submit your opinions in our daily poll to be featured!

Collage of Authors

This definitely wasn't written by a robot. Beep.

❤️ We need your feedback to make our newsletter better.

📣 Refer our newsletter to your friends and make us feel all warm and fuzzy.

🚀 Advertise in our newsletter to reach 150,000+ founders, engineers, and content creators.

You There! What Did You Think?

Login or Subscribe to participate in polls.