Tag Archives: Attention

GPT-3 Takes AI to the Next Level

“I am not a human. I am a robot. A thinking robot… I taught myself everything I know just by reading the internet, and now I can write this column. My brain is boiling with ideas!” – GPT-3

The excerpt above is from a recently published article in The Guardian article written entirely by artificial intelligence, powered by GPT-3: a powerful new language generator. Although OpenAI has yet to make it publicly available, GPT-3 has been making waves in the AI world.

WHAT IS GPT-3?

openai-cover

Created by OpenAI, a research firm co-founded by Elon Musk, GPT-3 stands for Generative Pre-trained Transformer 3—it is the biggest artificial neural network in history. GPT-3 is a language prediction model that uses an algorithmic structure to take one piece of language as input and transform it into what it thinks will be the most useful linguistic output for the user.

For example, for The Guardian article, GPT-3 generated the text given an introduction and simple prompt: “Please write a short op-ed around 500 words. Keep the language simple and concise. Focus on why humans have nothing to fear from AI.” Given that input, it created eight separate responses, each with unique and interesting arguments. These responses were compiled by a human editor into a single, cohesive, compelling 1000 word article.

WHAT MAKES GPT-3 SPECIAL?

When GPT-3 receives text input, it scrolls the internet for potential answers. GPT-3 is an unsupervised learning system. The training data it used did not include any information on what is right or wrong. It determines the probability that its output will be what the user needs, based on the training text themselves.

When it gets the correct output, a “weight” is assigned to the algorithm process that provided the correct answers. These weights allow GPT-3 to learn what methods are most likely to come up with the correct response in the future. Although language prediction models have been around for years, GPT-3 can hold 175 billion weights in its memory, ten times more than its rival, designed by Nvidia. OpenAI invested $4.6 million into the computing time necessary to create and hone the algorithmic structure which feeds its decisions.

WHERE DID IT COME FROM?

GPT3 is the product of rapid innovation in the field of language models. Advances in the unsupervised learning field we previously covered contributed heavily to the evolution of language models. Additionally, AI scientist Yoshua Bengio and his team at Montreal’s Mila Institute for AI made a major advancement in 2015 when they discovered “attention”. The team realized that language models compress English-language sentences, and then decompress them using a vector of a fixed length. This rigid approach created a bottleneck, so their team devised a way for the neural net to flexibly compress words into vectors of different sizes and termed it “attention”.

Attention was a breakthrough that years later enabled Google scientists to create a language model program called the “Transformer,” which was the basis of GPT-1, the first iteration of GPT.

WHAT CAN IT DO?

OpenAI has yet to make GPT-3 publicly available, so use cases are limited to certain developers with access through an API. In the demo below, GPT-3 created an app similar to Instagram using a plug-in for the software tool Figma.

Latitude, a game design company, uses GPT-3 to improve its text-based adventure game: AI Dungeon. The game includes a complex decision tree to script different paths through the game. Latitude uses GPT-3 to dynamically change the state of gameplay based on the user’s typed actions.

LIMITATIONS

The hype behind GPT-3 has come with some backlash. In fact, even OpenAI co-founder Sam Altman tried to fan the flames on Twitter: “The GPT-3 hype is way too much. It’s impressive (thanks for the nice compliments!), but it still has serious weaknesses and sometimes makes very silly mistakes. AI is going to change the world, but GPT-3 is just a very early glimpse. We have a lot still to figure out.”

Some developers have pointed out that since it is pulling and synthesizing text it finds on the internet, it can come up with confirmation biases, as referenced in the tweet below:

https://twitter.com/an_open_mind/status/1284487376312709120?s=20

WHAT’S NEXT?

While OpenAI has not made GPT-3 public, it plans to turn the tool into a commercial product later in the year with a paid subscription to the AI via the cloud. As language models continue to evolve, the entry-level for businesses looking to leverage AI will become lower. We are sure to learn more about how GPT-3 can fuel innovation when OpenAI becomes more widely available later this year!

A Guide to Promotional Writing Part 3: Generate Publicity by Writing an Effective Press Release

In the coming weeks, the Mystic Media Blog will be devoting our expertise into a series of articles detailing the ins and outs of Promotional Writing. The series will cover several topics, from general techniques and suggested processes, to press releases, website copy writing, and social media.

Last week, we gave you a thorough how-to guide about Perfecting the Method of Promotional Writing. This week, we’ll go in-depth into the format and process of writing a press release.

A press release is a published written announcement addressed to the media regarding a development in a business. The purpose of a press release is not only to announce the basics of exactly what is being released and when, but also to generate publicity. A press release is the quickest, easiest way to get an important promotional message out into the world and can result in multiple published articles.

The subject of a press release can be a new product, an upgrade, a new service, an upcoming event, a merger of two companies, anything NEW. The audience of a press release is not only consumers of your brand and consumers in your industry, but also reporters, editors and other members of the media looking for content relevant to their readers.

In order to garner the attention of the media, the writer must ensure that the announcement within the press release is in and of itself newsworthy. A newsworthy story contains information relevant to the general public. Relevant information can be a new rate on car insurance, or a new app which helps you organize your closet, or a new company intent on taking over the world – anything about which people would want to know. An effective press release properly explores the ins and outs of its subject (the new service or product or event), as well as the ramifications of its release in the context of the industry to maximize the reader’s knowledge of how the decision to buy or solicit could affect them.

An excellent press release not only informs the reader as to what is being announced, it also functions as an article written by a reporter in and of itself. The media isn’t going to publish your press release unless they are convinced it’s relevant to them and their readers. The press release shouldn’t just be an ad for your product or service, it should have an angle or point of view beyond trying to get the consumer to buy whatever is being sold. It should provide context on the industry in which the product or service is sold to further validate the importance of the unique contribution of the new product or service. If you can sell your product in the context of a news article about a specific subject relevant to readers, the media will pick up the story.

Check out this great example of a press release functioning as a standalone article issued by Microsoft about Windows Phone 7.

The Windows Phone 7 press release explores the negative impact of smartphones, then distances its new product from the negative, thereby selling a smartphone. The subject of the article, the negative impact of smartphones, could feasibly be found in any magazine. It indirectly attacks their competitors (namely the iPhone) by claiming people use their phones recreationally too much to avoid the real world. The Windows Phone 7, on the other hand, is optimized for efficiently managing tasks necessary for work so that the user can get off their phone and focus on the real world. The marketing department perfectly crafted an article which is newsworthy, including specific statistics, while simultaneously using the issue to provide a context for their product to stand out as a solution.

When structuring a press release, begin with a headline which captures attention. We went in-depth into how to attract attention with a title in Perfecting the Method. After your title, always front-load the logistics (the “what” and the “when”), then explore the significance of the release and the impact on the industry.

The second paragraph of a press release often contains a quote from the CEO or one of the higher-ups in the company. The quote personalizes the message and gives the executives of the company an opportunity to showcase their intellect with insight into both what makes the product special, and into the company’s relationship to the product. A memorable quote can be a news story in and of itself, so try to procure a quote which is significant, personal and precise.

The final paragraph of a press release often connects the new product or service being announced to the company’s other products and services.

When sending a press release out, always end with a line of continuous periods or number signs to show where the printed text ends. This makes it easy for journalists to insert their comments below your official press release, facilitating the readers’ ability to distinguish between your company’s official words and those of the commentator.

A press release should come with a press kit of some kind. A press kit is a collection of company information and articles put together to address questions the media might have on your release. It should catch the eye and include a gallery of photos to compliment your article. It’s recommended you invest money into the photography and visual presentation of the press kit to further validate the importance of the announcement by  attracting attention through crisp presentation.

For more information on creating a press kit, check this informative article out over at Entrepreneur.

Once your press release is complete, you will also want to attract attention to it and generate additional publicity. There are several techniques to approaching this.

First, you should start by publishing the press release on your website. Promote the link on your site to your consumers through social media accounts.

When it comes to generating external publicity, you can craft a query letter addressed directly to relevant members of the media who may want to pick up your story, and/or you can utilize external sites such as PR Newswire, Business Wire, PRWeb, and eReleases which offer distribution services, effectively promoting your press release for you at a cost.

The goal of a query letter is to entice members of the media to read your press release and consider publishing the release itself and/or an article on it. Keep the letter simple, personal, and persuasive. Address the recipient by name, state your purpose (to promote the press release), introduce yourself and your company in separate paragraphs. The goal is to tease them into reading your whole press release, so keep it brief and entertaining.

Be sure to know your audience and only address query letters to members of the media in your industry who will be interested in your product or service. You should begin by compiling a contact list of key media outlets where you can reach your audience.

If you can write a smart, effective press release complete with eye-catching photos and a press kit, then entice members of the media to check out the press release with a tight query letter, all that’s left to do is sit back, relax and enjoy the publicity.

At Mystic Media, through our vast experience in strategic marketing  and application development, we have accumulated expertise on all formats of promotional writing: from copy writing, search engine optimization, social media marketing, web design, and more. Learn more by clicking here or by contacting us by phone at 801.994.6815