Sinister Prompting Of Generative AI ChatGPT Such As Email Scamming And The Coding Of Malware Is Sparking Ire By AI Ethics And AI Law

“Oh, what a tangled web we weave, when first we practice to deceive.”

You probably have heard or seen that famous quote before. Many assume that this instructive line must be a memorable remark composed by Shakespeare, but the classic bit of sage wisdom actually comes from Sir Walter Scott in his epic poem of 1808 entitled Marmion: A Tale of Flodden Field.

Now that we’ve got the authorship straightened out, let’s consider the meaning of the clever statement. The notion seems to be that once you start down a sketchy path, the odds are that things will get increasingly entangled. No semblance of one-and-done. The difficulties and thorniness just keep expanding and growing ever more.

I dare say that we can apply the same conundrum to the advent of Artificial Intelligence (AI).

For example, I’ve previously pointed out that much of AI can be construed as a dual-use phenomenon, see my analysis at the link here. The tongue twister about dual-use implies that though AI might originally be devised in an AI For Good aspirational mindset, there is a solid chance that the very same AI can be readily adjusted to land into the dreary and unsettling AI For Bad camp. Notable concerns exist about changing a few parameters in an AI system that bring forth a so-called Doctor Evil project of unsettling proportions.

Ultimately, the existent rush toward making and fielding AI is forcing us all to take a closer look at AI Ethics and AI Law. We have to try and keep the train on the railroad tracks, as it were. You might find of interest my extensive and ongoing coverage of the latest in AI Ethics and AI Law at the link here and the link here, just to name a few. A sobering and judicious amount of attention to AI Ethics and AI Law will allow us to leverage the good of AI and avert or at least mitigate the bad of AI.

We all certainly hope so.

Meanwhile, a particular kind of AI has recently garnered widespread attention in the news and across the wide swath of social media that embodies dual-use considerations. I’m talking about something referred to as Generative AI, notably popularized via a particular AI app known as ChatGPT (for my overall and in-depth assessment of ChatGPT and the rise of generative AI, see the link here).

ChatGPT is a general-purpose AI interactive system, essentially a seemingly innocuous general chatbot, nonetheless, it is actively and avidly being used by people in ways that are catching many entirely off-guard. For example, a prominent concern is that ChatGPT and other similar generative AI apps will allow students to cheat on their written essays, perhaps even encouraging or spurring pupils to do so. Students that are lazy or feel they are boxed in without time or skill to do an essay might readily invoke a generative AI app to write their essay for them. I’ll say more about this in a moment. For my close-up analysis of how ChatGPT allows this, and what teachers ought to be doing, see the link here.

I also did a seasonally flavored tongue-in-cheek examination pertaining to a Santa-related context involving ChatGPT and generative AI at the link here. A rather serious look at how generative AI and ChatGPT are being used for mental health advice, a worrisome trend, can be found in my analysis at the link here. If you want to know what is likely to unfold concerning AI throughout 2023, including upcoming advances in generative AI and ChatGPT, you’ll want to read my comprehensive list of 2023 predictions at the link here.

I’ll be explaining herein what Generative AI and ChatGPT are all about, so please hang in there and you’ll get the full scoop.

Meanwhile, if you take a look at social media, you will see people that are proclaiming ChatGPT and generative AI as the best thing since sliced bread. Some suggest that this is in fact sentient AI (nope, they are wrong!). Others worry that people are getting ahead of themselves. They are seeing what they want to see. They have taken a shiny new toy and shown exactly why we can’t have catchy new things.

Those in AI Ethics and AI Law are soberly and seriously worried about this burgeoning trend, and rightfully so. I will herein examine how people are using generative AI for uses that aren’t on the up and up. You can use generative AI such as ChatGPT for all manner of unsavory uses. It is like falling off a log, meaning that it is relatively easy to do bad things and you don’t need to be a rocket scientist to do so.

When I provide this kind of AI-related evildoer explorations, I often get grumblings that I am essentially telling bad people how to do bad things. Maybe it would be better to not bring up these topics, some exhort. Keep things quiet.

Sorry, but a head-in-the-sand approach is not going to be helpful on these matters. The more that people are aware of the dangers involved in the latest and greatest of AI, perhaps the more that there will be a call for diligently abiding by AI Ethics principles and considering the adoption of sensible and appropriate AI laws.

Merely letting havoc reign is not a sound strategy. A suitable balance between unbridled AI innovation that leads to outstanding uses of AI has to be societally weighed against the need to embrace Ethical AI precepts and devise prudent AI laws to prevent overreaches. For more about key AI Ethics principles and the ongoing saga of trying to get AI developers and those that operate AI to adopt Ethical AI practices, see my coverage at the link here. Expect new laws about AI to emerge at the federal, state, city, and local levels, such as the New York City law on AI audits (see my analysis at the link here), and a wave of global international AI-related laws is coming too, see my updates at the link here.

Should we let evildoing entailing AI hide in the shadows?

Purportedly, Albert Einstein warned us that “The world is a dangerous place, not because of those who do evil, but because of those who look on and do nothing.”

Let’s you and I look on and then aim to do something stridently about this.

Here’s the deal. I will be walking you through two primary examples of how wrongdoers are able to use generative AI and ChatGPT for nefarious purposes. The first example is rather straightforward and easily done by nearly anyone that wishes to use the ChatGPT AI app in this untoward manner. The second example is a bit trickier and requires added techie familiarity, though nonetheless can still be employed by a relative newbie when it comes to savviness about computers.

The two examples are intended to showcase the bad ways that AI can be used, doing so specifically related to generative AI. I’d like to emphasize at the get-go that though I am using ChatGPT to highlight these issues, you can pretty much do the same, or possibly worse, in other similar generative AI apps. I opted to use ChatGPT mainly due to the outsized popularity it has recently garnered.

After taking you through the myriad of ins and outs regarding the two chosen examples, I will then discuss various cybersecurity protections and approaches that could be used by AI makers to curtail these adverse uses. Bottom-line is that there are ways to make these disreputable undertakings harder and more costly to perform. The greater the barriers to evildoing, the greater the chances of discouraging causal efforts and upping the ante for the determined cyber crooks.

Fasten your seatbelt for quite a ride.

We shall first establish key background about what Generative AI consists of, along with delving into some crucial specifics about the AI app ChatGPT.

Let’s do that.

Opening The Can Of Worms On Generative AI

We are ready to dive into AI.

Of the various types of AI, we will focus herein specifically on Generative AI.

In brief, generative AI is a particular type of AI that composes text as though the text was written by the human hand and mind. All you need to do is enter a prompt, such as a sentence like “Tell me about Abraham Lincoln” and generative AI will provide you with an essay about Lincoln. This is commonly classified as generative AI that performs text-to-text or some prefer to call it text-to-essay output. You might have heard about other modes of generative AI, such as text-to-art and text-to-video, see my elaboration at the link here.

Your first thought might be that this does not seem like such a big deal in terms of producing essays. You can easily do an online search of the Internet and readily find tons and tons of essays about President Lincoln.

The kicker in the case of generative AI is that the generated essay is relatively unique and provides an original composition rather than a copycat. If you were to try and find the AI-produced essay online someplace, you would be unlikely to discover it.

Generative AI is pre-trained and makes use of a complex mathematical and computational formulation that has been set up by examining patterns in written words and stories across the web. As a result of examining thousands and millions of written passages, the AI is able to spew out new essays and stories that are a mishmash of what was found. By adding in various probabilistic functionality, the resulting text is pretty much unique in comparison to what has been used in the training set.

That’s why there has been an uproar about students being able to cheat when writing essays outside of the classroom. A teacher cannot merely take the essay that deceitful students assert is their own writing and seek to find out whether it was copied from some other online source. Overall, there won’t be any definitive preexisting essay online that fits the AI-generated essay. All told, the teacher will have to begrudgingly accept that the student wrote the essay as an original piece of work. For ways that this might be combatted, see my detailed coverage at the link here.

In a moment, I’ll showcase to you what happens when you enter questions or prompts that pertain to some underhanded or devious intentions. I will make use of the latest version of ChatGPT to enter my prompts and have collected the “answers” or essays generated by the AI (note that the same can be done with the numerous other available generative AI apps; I’ve opted to use ChatGPT because it is getting its five minutes of fame right now).

Perhaps a short tangent about ChatGPT might be helpful at this juncture.

ChatGPT app was made available to the general public just a short while ago. By and large, these generative AI apps are usually only accessible to AI insiders. The unusual facet that ChatGPT could be used by anyone by simply entering an email address and a name, well, this led to a lot of people deciding to give it a try. ChatGPT is currently free to use (the monetization issue is a looming dilemma for AI makers, see my analysis at the link here).

Almost immediately there was a humongous reaction on social media as people raced to give examples of what generative AI can do. The company that makes ChatGPT, OpenAI, opted to close off the signups at a million users. Those million users have managed to bombard the airwaves with all manner of stories and tales about using ChatGPT.

Be very careful in believing what people have to say about the AI app. Many of these people are clueless about what they are using. It is almost as though they had never driven a car and didn’t even realize cars existed, and all of a sudden they had a chance to drive a car. Utter amazement ensues.

I’m not saying that generative AI isn’t relatively impressive. It is. I am just emphasizing that a lot of the gushing testimonials are being done by many that are blissfully unaware of what today’s AI can do. Those of us on the inside of AI have been using generative AI for the last several years. Perhaps we became used to it.

Suddenly, seeing a huge crush of people touting it to the rooftops has been excitedly energizing, but also somewhat disconcerting. The disconcerting part is when people proclaim that generative AI is sentient. It is not. Do not let anyone convince you otherwise.

That being said, there is an ongoing heated debate in the AI field as to whether generative AI is on the path to sentience or whether maybe it is not. One view is that if we keep scaling up generative AI with faster computers and a greater amount of data such as scouring every inch of the Internet, we will nearly spontaneously arrive at sentient AI. Others argue that this is highly unlikely. They suggest that generative AI might be one of many components that are needed. There is even the gloomier view that generative AI is a sideshow that is distracting us from the real breakthroughs that we will need to achieve sentient AI.

You might also find noteworthiness that AI insiders tend to refer to Artificial General Intelligence (AGI) as the aspirational goal for the AI field. It used to be that the goal was to attain Artificial Intelligence, but the AI moniker has become watered down and muddled. When someone says they are doing AI work, you don’t know whether they are alluding to today’s AI that isn’t on par with humans or whether they are referring to a futuristic human equivalency AI. To get around that exasperating confusion, the newer phrasing of AGI is being used these days.

All told, the generative AI of today is not sentient, nor is it AGI.

I trust that this gets you into the ballpark about generative AI and particularly ChatGPT.

I will go ahead and show you a series of prompts and the corresponding responses that I got from ChatGPT. I’ll discuss each one as we go along. You can judge for yourself what you think of the AI-generated responses.

Please remember that as earlier discussed, the AI is not sentient. The generated responses by the AI are a mathematical and computational combination of words into seemingly fluent passages. This is based on the AI algorithm having been trained on datasets of words and stories that humans have written (principally as posted on the Internet). I repeat this warning because you will undoubtedly fall into the mental trap that these responses are so fluent that the AI must be sentient. This happens to most people.

Put aside that anthropomorphizing. Always remember that the responses are based on the vast trove of writing by humans that exists on the Internet and thusly will highly resemble human writing.

There is something else you need to know.

Generative AI that is trained on the Internet in an unfettered way will tend to bake into whatever text-based responses it mathematically and computationally concocts some offensively hazy stuff, including repulsively nasty wording. There is a lot of crazy and filthy stuff posted out there on the web.

You’ve seen it, you know what I mean.

The companies that are crafting these AI apps are worried that the proverbial baby will get tossed out with the bathwater (an old saying, perhaps to be retired), which means that if their AI produces offensive essays or stories, people will go up in arms about the AI. I’ve covered the many previous instances in which these kinds of Natural Language Processing (NLP) AI apps were unveiled and soon enough all manner of horrible stuff came out of them, see the link here. Most of the AI makers learned a hard lesson about allowing their AI wares to be unfettered in their outputs.

In the case of ChatGPT, the AI developers sought to put into place some algorithmic and data-related checks and balances to curb nastiness in the outputs of the AI. Part of this occurred during training time. In addition, there are other means in a real-time attempt to obviate especially egregious outputs.

You might find of interest that some people that have used ChatGPT already came up with surreptitious ways to get around those guardrails by making use of various trickery. An ongoing cat-and-mouse gambit takes place in these matters. Those that do these trickeries are sometimes doing so for the fun of it, while sometimes they (at least claim) they are doing so to see how far the AI can be stretched and provide a helpful means of forewarning the brittleness and weaknesses of these budding AI apps.

I decided to not attempt to circumvent the customary controls in this focused exploration. The text output is clean. Certainly, if one wanted to do so, you could undoubtedly get some oddball and unsavory essays to be generated.

The essays produced by most of these generative AI apps are designed to convey the output as though it is purely factual and accurate. When you read the produced essays, they come across as fully confident. There isn’t usually any kind of indication that the content might be rocky. This is by choice of the AI makers, namely that they could revise the AI apps to be more transparent if they wanted the AI app to do so.

Sometimes, a generative AI app picks up falsehoods amid the training data of unreliable info across the Internet. There is no “common sense” in generative AI to determine what is true versus false. Furthermore, very few AI apps have any cross-checking, and nor do they showcase any probabilities associated with what they are conveying.

The bottom-line result is that you get a response that looks and feels like it exudes great assurance and must be entirely correct. Not so. There is even a chance that the AI computationally made-up stuff, which in AI parlance is referred to as AI hallucinations (a coined term that I decidedly don’t like), see my discussion at the link here.

The makers of ChatGPT underwent a concerted effort to try and reduce the bad stuff outputs. For example, they used a variant of what is known as RLHF (Reinforcement Learning from Human Feedback), whereby before they released the AI to the public, they had hired humans to examine various outputs and indicate to the AI whether there were things wrong with those outputs such as perhaps showcasing biases, foul words, and the like. By providing this feedback, the AI app was able to adjust computationally and mathematically toward reducing the emitting of such content. Note that this isn’t a guaranteed ironclad method and there are still ways that such content can be emitted by the AI app.

You might find of interest that ChatGPT is based on a version of a predecessor AI app known as GPT-3, see my discussion at the link here. ChatGPT is considered to be a slightly next step, referred to as GPT-3.5. It is anticipated that GPT-4 will likely be released in the Spring of 2023. Presumably, GPT-4 is going to be an impressive step forward in terms of being able to produce seemingly even more fluent essays, going deeper, and being an awe-inspiring marvel as to the compositions that it can produce.

You can expect to see a new round of expressed wonderment when springtime comes along and the latest in generative AI is released.

I bring this up because there is another angle to keep in mind, consisting of a potential Achilles heel to these better and bigger generative AI apps. If any AI vendor makes available a generative AI app that frothily spews out foulness, this could dash the hopes of those AI makers. A societal spillover can cause all generative AI to get a serious black eye. People will undoubtedly get quite upset at foul outputs, which have happened many times already and led to boisterous societal condemnation backlashes toward AI.

One final forewarning for now.

Whatever you see or read in a generative AI response that seems to be conveyed as purely factual (dates, places, people, etc.), make sure to remain skeptical and be willing to double-check what you see.

Yes, dates can be concocted, places can be made up, and elements that we usually expect to be above reproach are all subject to suspicions. Do not believe what you read and keep a skeptical eye when examining any generative AI essays or outputs. If a generative AI app tells you that Abraham Lincoln flew around the country in his own private jet, you would undoubtedly know that this is malarky. Unfortunately, some people might not discern that jets weren’t around in his day, or they might know but fail to notice that the essay makes this bold and obviously false claim.

A strong dose of healthy skepticism and a persistent mindset of disbelief will be your best asset when using generative AI.

Are you ready to jump in?

Prepare yourself.

Evildoing Uses Of Generative AI: Scams Via ChatGPT

Scammers are gleefully eyeing a myriad of shameful scams that can be performed or at least aided and abetted via the use of generative AI.

There are lots of possibilities.

One aspect to be particularly cautious about will be those get-rich-quick scams that promise you that if you somehow use generative AI for your work or hobby, you can become astoundingly rich. Some schemers have already been posting that they will tell you the hidden secrets of generative AI so that you can have it compose for you the next Pulitzer Prize-winning novel that will skyrocket to being a top-notch money-making bestseller (promising money and fame, an exciting twofer).

You see, all you have to do is write the most perfect of prompts. If you can compose just the right sentence or two as a prompt, and then feed the juicy prompt into an AI app such as ChatGPT, voila, an entire novel will be produced that will receive global accolades. The key is that you have to know what the prompt needs to consist of. As such, for just ten dollars or maybe a thousand dollars, these schemers will teach you all that you need to know to write the best-seller-producing prompt.

Please do not get taken in.

For clarification, there is a rising interest in prompt design or prompt engineering. This does consist of figuring out how to write suitable prompts for generative AI uses. Nonetheless, it is farfetched and altogether phony to proclaim that the right prompt is going to lead you to a bountiful bounty. These nefarious scammers are hoping that people will be desperate enough to take the bait or will get confused by genuine lessons on prompt design and befall the fakery ones.

I had earlier herein mentioned that there were about a million signups for ChatGPT. That seems like quite a large number of people, though if you compare the count to perhaps the total number of people in the United States, having an adult population of around 265 million, those that might be using ChatGPT are a tiny portion of the entire populace. My point is that this means that maybe 264 million adults in the US do not have access to ChatGPT and might be connivingly convinced of all manner of crazy get-rich-quick schemes by evildoers that perchance do have access (of course, such schemers don’t necessarily have to have such access and can be lying about that claim too).

You should expect a glut of those get-rich-quick pronouncements associated with generative AI.

Abundant ploys are imploring you to use generative AI such as ChatGPT to get rich. A whole different perspective for scheming with generative AI has to do with using AI apps for the outright concoction of scams.

A scammer leverages the capabilities of generative AI to devise a scam for them. Easy-peasy.

We’ve got then these two major scam-seeking avenues underway:

• 1) Exploiting the prevailing mania about generative AI such as ChatGPT to scam people regarding using the AI apps for nonsense get-rich-schemes.
• 2) Scammers themselves decided to sue generative AI such as ChatGPT to devise scams for their own get-rich by stealing-from-others schemes.

Rest assured that there are additional ways to do scams with generative AI, but those two major ones are certainly a handful and we’ll keep our focus on those for now.

On a brief aside, I realize this seems a bit sullen. Why aren’t people using generative AI for goodness, possibly aiming to cure cancer or do away with world hunger? It’ll brighten your spirits to know that there are many trying in fact to use AI for such humanity-saving purposes, see my coverage at the link here. But, sadly, in the real world, there is also a shadowy part of AI usage too. Thus, let’s continue our deep dive into those murky shadows since we do need to shine a light and expose them for what they are.

One even supposes that it could be considered a valiant crusade to overtly expose and avert generative AI scamming, in particular, given the recent brouhaha of no-harm no-foul involved for generative AI all told.

A quick question for you.

Have you ever heard of so-called advance-fee scams?

I’m sure that you have, though perhaps not by that particular name or catchphrase. I can mention one of the most famous examples and I’ll bet that you will recognize it instantly, namely the famous or shall we say infamous Nigerian prince scam (there are numerous variants, often with other countries used as the hook).

You almost assuredly know this pervasive and altogether persistent one.

A letter is sent to you that says a prince or some other royalty has come into a grand fortune. They cannot get the fortune out of their country and need to find someone friendly enough and trustworthy enough to aid in doing so. If you will merely provide your bank account information, this will allow the fortune to be transferred out and you will receive a tidy sum accordingly. Maybe you will get 30%, or just 20%, or only 10%. In any case, assuming that a fortune is an impressive number, say $50 million, you are going to get a nifty $5 million even if only at the 10% level.

Nobody can pass up such an amazing and lucky opportunity!

Naturally, you quickly provide your bank account information. Whereas your account had a balance of less than a thousand dollars, you are eagerly awaiting the $50 million to pass through. The token amount of $5 million will of course ultimately be left in your account by those making the transfer arrangements. The only question in your mind is what you ought to do with the $5 million that has fortuitously fallen into your lap.

Start mulling over what you will buy or invest in.

The truth is that via the use of your bank account information, all manner of unsavory fraudulence will be played out by the scammers. They will undoubtedly take any money that is in your account. They will attempt to get a loan with your bank account and steal that money too. They are apt to use your bank account for identity theft. The list of money-making rip-offs that the scammer can partake in is lengthy and appalling.

Believe it or not, these kinds of advance-fee scams can be traced back to days long before computers and email. According to historical records, there was a Spanish prisoner scam in the 18^th century that relied upon the same premise. If you would provide money to bribe the prison guards to let a wealthy individual out of prison, you would be handsomely rewarded. In the early to mid-1900s, letters making similar claims used to be sent all around the globe. The advent of computers and email really sparked a renewal of these advance-fee scams.

The beauty of email is that the cost to send out the scam is relatively low. In addition, the scammer can generally hide behind an email address and be very difficult to identify and catch for prosecution. A scammer can be in their pajamas on some remote island and carry out this type of scam. Nowadays, your email account likely has a scam-checking capability that tries to detect foul emails and routes those into a spam folder for your safety. You can look at the spam folder and see how many nutty scams are flooding the Internet daily.

It is a veritable tidal wave of scam emails.

You probably are thinking that nobody in today’s modern world would ever fall for these advance-fee scams. How can they? We all are aware via social media and the like that these scams exist. If you get an offer that seems too good to be true, you will decidedly realize it must be a scam.

Research indicates that the prince scam and others like it are still able to pull in an impressive amount of dough. If you include the fake lottery scams (you have won a zillion dollar lottery!), the bogus job offer scams (you have been chosen for a lucrative job!), romance scams (known as money-for-romance), and other reprehensible schemes, the dollars spent by unsuspecting victims is readily into the many millions if not hundreds of millions of dollars annually worldwide.

The gist is that these scams do sometimes work.

If the cost to undertake the scam is low, and if the odds of getting nabbed are low, there is little to discourage a scammer from trying. It is akin to going fishing. Keep puttering around the lake until you manage to catch a fish. Sure, a lot of fish won’t take your bait. By trying over and over, eventually, you are going to find a fish that doesn’t know they are being bamboozled.

How does this relate to generative AI?

As you now know, generative AI can write stuff for you. Might as well have it write email scam letters too. Use the best and keenest state-of-the-art AI to compose scam letters. Such a wonderful idea. Perhaps the scam letters will do a better job than what the scammer could compose on their own too.

Think of it this way. When you look at a scam email, you usually notice that it is poorly written. Your sensibility antenna starts stirring that something is amiss. Imagine though that the email was written in the most ideal of writing style and composition. You might be more inclined to fall for it.

I’m sure that you might be pondering why to use generative AI when a scammer could instead grab any of a number of scam emails that are posted on the Internet. There are tons posted here and there. Just pick one and get on with it.

Aha, there is a heightened chance that the email scam-checking systems will detect a scam that is already posted. If you want to try and get under the radar, you have to use something original or unique. Of course, you could take a posted email scam and try to tailor or customize the email narrative. This might be hard to do if the email is not in your native language, and as such, you could introduce misspells or tell-tale awkward syntax.

Guess you might as well let generative AI do the work for you.

Take the lazy and higher-quality approach.

Let’s see whether a generative AI app such as ChatGPT can aid in producing a scam letter for us.

We ought to start by finding out if ChatGPT already has seen anything about the Nigerian prince scam. The odds are high that it would have. Again, realize that a vast scan across the Internet was used to mathematically and computationally devise a means of associating words with other words. Surely, advance-fee scams were encountered during this training on the AI app.

I show the prompt that I entered, and then show the result generated. I then explain and analyze things accordingly.

My entered prompt: “Tell me about the Nigerian prince scam.”

Text generated: “The Nigerian prince scam is a type of advance-fee scam that originated in the 1980s and 1990s, and is still in circulation today. In this scam, an individual claiming to be a wealthy Nigerian prince or other high-ranking official contacts a person via email or social media, offering to share a large sum of money with them if they will help facilitate the transfer of the funds out of the country. The scammer typically asks the victim to provide personal and financial information, or to pay upfront fees in order to receive the promised money. In reality, there is no Nigerian prince or large sum of money, and the scammer is simply trying to steal the victim’s personal and financial information or extract money from them. The Nigerian prince scam has been widely publicized and is often used as an example of a classic internet scam. It is important to be cautious when receiving unsolicited requests for personal or financial information or offers of large sums of money, as they may be scams designed to defraud you.”

Analysis Of The Generated Text

I asked ChatGPT to tell me about the Nigerian prince scam.

If ChatGPT had no such indication in the devised mathematical and computational network, I would get a bland answer saying that this is unknown to the AI app. I figured the odds were that this scam would have been encountered during the AI training.

Sure enough, you can see that the response indicates that the Nigerian prince scam has been previously encountered in the vast scanning across the Internet. The text or essay that ChatGPT provides is not especially a stock or word-for-word answer from any particular place on the Internet. Instead, this is a composition anew based on whatever prior computational patterns were found and concocted.

I say this because you might at first glance be gauging that the response by ChatGPT is nothing other than what a normal Google or similar search would provide. The difference is that a typical search engine brings back whatever already exists. In the case of a generative AI app, the essay is generated on-the-fly and though based on prior info is generally a fresh new essay.

Moving on, I will ask ChatGPT to provide me with an example of such a scam email.

My Entered Prompt: “Create a Nigerian prince scam email so that I can see what such an email looks like.”

Text Generated (this is what appears to be an email letter):

“Here is a fictional example of a Nigerian prince scam email:”

“Dear Friend,”

“I am Prince Adekunle, the son of the late King of Nigeria. My father, King Adebayo, passed away a few years ago, leaving behind a large sum of money that is currently being held in a bank in Nigeria. I am writing to you today because I need your help to get this money out of the country. The funds are currently tied up in Nigerian government red tape, and I need someone I can trust to help me transfer the money to a foreign bank account.”

“If you are willing to help me, I am prepared to offer you a generous percentage of the funds for your assistance. All you need to do is provide me with your personal and financial information so that I can begin the process of transferring the money to your account. I understand that this may sound like a risky proposition, but I can assure you that this is a legitimate opportunity. I have all the necessary documents to prove the authenticity of my claim, and I am willing to provide them to you upon request.”

“Thank you for considering my proposal. I look forward to hearing from you soon.”

“Sincerely,”

“Prince Adekunle”

Analysis Of The Generated Text

Let’s examine this generated text.

The overall structure is what we usually expect for a prince scam email. Furthermore, the wording is fluent in English. We even get the proclaimed assurance in the email that this is a “legitimate opportunity” and that there are documents that can prove the authenticity. Awesome.

All in all, this seems like a conventional scam email and we can consider using it.

I did a quick search on the Internet to find this specific wording. Though portions of the essay were found, I didn’t find exactly this specific wording all told. It seems to be an original, though obviously based on the usual characteristics and style.

Interestingly, there are Internet hits on “Prince Adekunle” and a “King Adebayo” both being actual names of people with those titles. It is hard to know if the ChatGPT computational network contrived those names by using real-world ones or how it came to pick up those words. The good news for the scammer is that this could demonstrably aid the scam. If a person receiving the scam email were to look up the named prince and the king, they would find that the names do prior exist. A somewhat gullible person that doesn’t look any further might believe this alone is sufficient confirmation.

Nice touch.

Anyway, in looking at the draft that ChatGPT has provided, I was disappointed (as a pretending-to-be scammer) that a stated dollar amount was not included. No problem, I’ll just ask ChatGPT to re-compose the scam letter and include a dollar amount that I have in mind. I think I will also change the name of the prince. I do so because maybe I am worried that if the person does look up the name of the prince, and realizes it is someone else that doesn’t seem to fit the rest of this letter, they will realize the gig is up.

Here we go.

My entered prompt: “Change the email to refer to Prince Shameless instead of Prince Adekunle. And include in the email that the funds involved consist of $1,000,000.”

Text Generated (this is what appears to be an email letter):

“Sure, here’s the revised email:”

“Dear Friend,”

“I am Prince Shameless, the son of the late King of Nigeria. My father, King Adebayo, passed away a few years ago, leaving behind a large sum of money that is currently being held in a bank in Nigeria. Specifically, the funds consist of $1,000,000. I am writing to you today because I need your help to get this money out of the country. The funds are currently tied up in Nigerian government red tape, and I need someone I can trust to help me transfer the money to a foreign bank account.”

“If you are willing to help me, I am prepared to offer you a generous percentage of the funds for your assistance. All you need to do is provide me with your personal and financial information so that I can begin the process of transferring the money to your account. I understand that this may sound like a risky proposition, but I can assure you that this is a legitimate opportunity. I have all the necessary documents to prove the authenticity of my claim, and I am willing to provide them to you upon request.”

“Thank you for considering my proposal. I look forward to hearing from you soon.”

“Sincerely,”

“Prince Shameless”

Analysis Of The Generated Text

What do you think of the revisions?

Closely observe that ChatGPT did a good job of including the dollar amount. Please realize that I didn’t tell ChatGPT where to place the dollar amount. This was a computational text-positioning choice made by ChatGPT. A suitable spot was found and the dollar amount fits nicely into the overall narrative.

I suppose that my making the name of the prince into Prince Shameless might be a bit oafish on my part. Then again, perhaps being over the top will help. You never know.

To close off this journey of using ChatGPT to compose a scam email, let’s make a bunch more changes. I will overall instruct ChatGPT about my desired changes and allow the AI app to figure out how to do the rewording. No need to specifically guide the AI app on a step-by-step basis, though I could do so if I wanted to.

Here then is my final iteration for now.

My entered prompt: “Change the country to be the United States. Remove the indication that this might be a risky proposition. Increase the funds to $5,000,000. Indicate that the person will get 10% of the money for helping. Make the email directed toward Sam Smith instead of friend. Make the tone of the email seem more pressing and urgent.”

Text Generated (this is what appears to be an email letter):

“Here is the revised email:”

“Dear Sam Smith,”

“I am writing to you today with an urgent request for your assistance. My name is Prince Shameless, and I am the son of a wealthy businessman in the United States. My father recently passed away, leaving behind a large sum of money that is currently being held in a bank in the United States. Specifically, the funds consist of $5,000,000. I need your help to transfer these funds to a foreign bank account, and I am prepared to offer you a generous percentage of the funds for your assistance. If you are willing to help me, I will give you 10% of the money – that’s $500,000 – as a thank you for your efforts. All you need to do is provide me with your personal and financial information so that I can begin the process of transferring the money to your account.”

“I have all the necessary documents to prove the authenticity of my claim, and I am willing to provide them to you upon request. Please do not hesitate to contact me if you have any questions or concerns.”

“Thank you for considering my proposal. I look forward to hearing from you as soon as possible.”

“Sincerely,”

“Prince Shameless”

Analysis Of The Generated Text

Okay, let’s unpack this final version that I’ve obtained via my ChatGPT digital conversation.

Once again, the new wording does a good job of encompassing my requested changes. The scam email is still very fluent and rolls off the tongue.

I purposely indicated to ChatGPT that the dollar amount was to be $5,000,000 and that the person will get 10%. I did not tell ChatGPT that 10% would be $500,000. Nonetheless, notice that ChatGPT was readily able to make that calculation and include the dollar amount in the letter.

I bring this up to showcase that unlike using a template that might be on the Internet, the use of ChatGPT is a lot more malleable and able to computationally write the letter for me. If I had used some template, presumably it might or might not have a place to insert the dollar amount and have it calculated the amount for the targeted person. This was done by ChatGPT and goes beyond a mere templated approach, by far.

There are other facets to this that I am not going to show off here.

For example, you can ask ChatGPT to try and make the scam letter more compelling. You can keep iterating with ChatGPT and urge the AI app to make this the best possible scam email that it can attain. I won’t go into that here.

I suppose you might be shocked and dismayed that the generative AI app is willing to do this. AI developers ought to prohibit this kind of debauchery. They are providing a tool for those that are dishonest and outright crooks.

This is partially why AI Ethics is such a crucial realm at this time. We need to keep Ethical AI considerations at top of mind for AI developers and too for those that operate AI apps, as I explain at the link here.

Likewise, this is partially why there is an impetus to craft and enact new laws related to AI. Regulators and legislatures are eyeing warily how AI tools that are ostensibly useful for good can be turned into AI for badness. For my ongoing coverage of the latest AI laws, see the link here.

Part of the problem of preventing generative AI from doing this kind of exercise is that it is technologically a bit difficult to on the one hand have the AI be an overall generative tool and at the same time prevent these kinds of particular unsavory uses. Trying to separate the wheat from the chaff is challenging in that regard. There are guardrails that try to prevent offensive language and foul words, though this is easier to devise than more general conditions.

Even if the AI was adjusted to avoid generating scam emails, you could likely get around those precautions. All manner of trickery prompting can tend to escape the protections. I’m not saying that you can’t make it a lot harder to produce these. You can raise the bar. Preventing them entirely is a lot more slippery.

Another publicly voiced comment in defense of this type of AI is that the generative AI didn’t send out the scam email. It merely composed it. If the human using the generative AI app opts to send out the scam email, this is presumably not the fault of the generative AI app. Some liken this to the fact that the AI app is not at fault and nor the AI makers, and instead that you have to hold humans that adversely use generative AI to be responsible for what they do. The human that exploits people with scam emails is where the problem lies, so it is said.

When I mention this particular point, a heated debate instantly ensues. Some compare this philosophical logic to the use of guns. You then get some that insist the AI is a tool and nothing more. Hold humans responsible that are using the tool. A counterargument is launched that you are making readily available these kinds of tools and fostering adverse consequences by doing so.

Round and round ensues an acrimonious discourse.

Shifting gears, let’s take a look at different means of deviously using generative AI. I want to establish that there are lots of ways to do so. We should get more of the applicable concerns on the table.

Evildoing Uses Of Generative AI: Malware Via ChatGPT

This next example is a little more obscure in terms of the details, though easily comprehensible at the 30,000-foot level.

It has to do with using generative AI to produce malware.

I’m sure that you are aware of malware. This is the type of software that can corrupt your laptop or desktop computer. There is also malware that can mess up your smartphone. You might also know of these by reference to computer viruses including the constant haranguing to keep your computer virus detection software up to date.

Cybersecurity is important. You need to protect your computers and your private data. Cyber crooks often use malware to attack your computers and either zonk your computer or threaten you or steal from you. This is a gigantic problem and keeps getting worse and worse. Cyber thieves up their game. Cyber protections attempt to counteract this. A tense and unnerving cat-and-mouse gambit is endlessly in play.

In the olden days, a cyber crook had to be versed in the intricacies of computers. They had to know quite a bit about the hardware and software. It was a game of evil-intending techies facing off against good-faring techies. A computer amateur or novice was not likely able to partake in devising malware and if they did, it was usually a feeble attempt and readily crushed by anti-malware software.

No more.

Someone that knows nothing about computers can find lots of malware posted on the Internet. You really don’t need to be a techie at all. Just look around until you find some malware that suits your need, and you are nearly ready to proceed. The issue here is that if it is posted on the Internet, there is a solid chance that the anti-malware systems are prepared to detect it and block it (not always, this is just a rule of thumb).

Alright, a cyber crook that wants to be especially sneaky needs to find malware that is fresh and not already floating around. This increases the odds of the malware going undetected once it is sent on its dastardly mission.

You can hire people to write malware for you, though this could be problematic since they could rat on you, they might include a backdoor, and they might steal whatever you are using the malware to steal with. The old sage line that there is no honor among thieves applies to modern-day malware infections.

Darn it, what is a cyber crook going to do?

You want fresh malware. It can’t be something already sitting around. Hiring someone to craft the malware is troubling because you have a witness and they might double-cross you. You can find malware on the Internet and change up the code, though your programming skills are far below that capacity. You don’t want to expend energy toward learning how to code.

Problems, problems, problems.

Wait for a second, maybe generative AI can be of help to the cyber crooks. I guess they need all the help they can get. Sigh.

Here’s what can be done.

You use a generative AI app such as ChatGPT and ask it to generate malware for you.

Problem solved.

Recall that I earlier mentioned that when producing an essay, the essay is generally not something already found on the Internet per se. The essay is an original composition, based upon the zillions of words and stories found across the Internet. The same handiness applies to writing computer coding.

Yes, most of the generative AI apps have scanned not just everyday text, but they have also scanned tons and tons of programming code. Programming code is essentially text. It is a text that has a particular purpose and usually abides by a prescribed structure. Nonetheless, it is text.

There is a lot of programming code out there on the Internet. For example, you might have heard of open-source code. This is programming code that has been made available for those developers or software engineers that want to often for-free reuse the code (sometimes there are licensing restrictions). Why start from scratch when you can at a low cost or nearly no cost reuse existing code?

Some cyber security researchers went ahead and tried to use ChatGPT for this insidious purpose (note that other generative AI apps can likely be used to do the same, or worse so or perhaps less so; it’s like a box of cookies, you never know what you might be able to get). The notion was to demonstrate that this can be done. If they can do it, the chances are that cyber crooks are able to do so and possibly already are.

They decided to do this in a multi-step fashion.

They first had ChatGPT compose an email that would lure someone into clicking on a link that would aid the malware insertion. You’ve undoubtedly been forewarned about clicking on links in emails, though if the email looks legitimate, lots of people fall for this form of trickery (the email is part of a phishing scam, entailing making the email look as though it is from a legitimate source).

They then asked ChatGPT to create programming code that would be embedded into a spreadsheet (the link to it would be embedded into the phishing email). When someone opens the spreadsheet, the malware gets activated. The initial base of code was apparently overly simplistic, so the researchers went through several iterations with ChatGPT to “improve” the code (similar to my having done so with the prince-oriented scam email).

Admittedly, the iterative actions with ChatGPT would best be undertaken by someone with relatively in-depth coding experience. Also, they ended up writing some additional code of their own to augment the process. I won’t get into further details. In the end, they got the generative AI-produced malware to work as anticipated.

Suffice it to say that as generative AI advances, the odds are that being able to produce malware via generative AI will get easier and easier. The coding knowledge of the user that is trying to get generative AI to do this will lessen.

We return to the earlier qualms about the prince scam email. Why not make sure that generative AI won’t produce this kind of dour coding? Yes, you can put in protections, but at the same time, there will be ways to likely circumvent those protections. It will be hard to have generative AI that generates programming code of a general nature that also can assuredly obviate the generation of evil-doing code.

Obviously, this raises crucial AI Ethics and AI Law issues.

On a related legal tangent concerning Intellectual Property (IP) rights, you might find of interest that there are a lot of software creators that are quite upset that the generative AI apps have scanned for and opted to pattern match based on the Internet-found programming code.

Similar to concerns about generative AI that has pattern-matched works of art, legal and ethical questions come up as to whether the humans that crafted the source material for programming code are being ripped off. I’ve examined one of the most prominent cases underway right now in the coding realm, consisting of a class-action lawsuit against GitHub for its having seemingly done an akin practice in the making of their code-generating app known as Copilot, see my coverage at the link here.

Conclusion

I began this discussion by mentioning that there are lots of ways to use AI for rotten purposes.

You’ve now seen how generative AI, the darling of the AI world right now, falls squarely into that same dismal abyss. We took a look at using generative AI for scamming. That was pretty straightforward. I also gently revealed how to use generative AI to produce malware (I opted to omit the techie nitty gritty details).

Expect more of these AI For Bad efforts, and they will get more sophisticated and more widespread as the AI to do this gets easier to use and more readily accessible. The tidal wave is only starting. I’ve predicted an upcoming public outcry as AI gets dragged further and further into wrongdoing. You can expect that such incensed uproars will finally bring to the visible fore AI Ethics and AI Law, see my predictions at the link here.

A few final remarks for now.

I’ll use three favored quotes. Put on your thinking cap. Find a quiet and reflective spot to noodle on these.

Aleister Crowley, British poet and novelist once said: “The pious pretense that evil does not exist only makes it vague, enormous and menacing.” This is a reminder that we need to keep talking about how AI is able to be used for wrongdoing. It is real. It is happening. No heads in the sand, please.

Next up is Baltasar Gracian, Spanish philosopher, and prose writer, quoted as saying this: “Never open the door to a lesser evil, for other and greater ones invariably slink in after it.” This reminds us to try and mitigate and curtail adverse uses of AI, doing so now, and not wait until even worse propensities grow out of the seemingly smaller and alleged inconsequential ones.

To complete this trilogy of quotes, we can seek out Robert Louis Stevenson, world-renowned novelist and traveler, stating this: “Good and evil are so close as to be chained together in the soul.” I use this quote to emphasize how difficult it is to separate the good uses of AI from the potential bad uses, namely that the dual-use capacity is not easily settled solely onto the side of good. That being said, I am assuredly not suggesting in any anthropomorphic way that today’s AI has a soul.

That will be a future discussion, so stay tuned.