“ChatGPT is an interesting experiment at the moment, but its wider availability certainly appears to present new challenges. I have been playing with it since its public availability in November of 2022 and it is quite easy to convince it to assist with creating very convincing phishing lures and responding in a conversational way that could advance romance scams and business email compromise attacks. OpenAI seems to be trying to limit the high risk activities from abusing its use, but the cat is now out of the bag. Today the biggest risk is to English speaking populations, but it is likely only a matter of time before it is available to generate believable text in most commonly spoken languages of the world. We have reached a stage where humans are unlikely be able to discern machine generated prose from human written in casual conversations with those we are not intimately familiar which will security filters to aid in preventing humans from being victimized.”
– Chester Wisniewski, Field CTO Applied Research, Sophos