Talking heads? Beer label uses facial recognition to “chat” and detect consumer emotion

636667223242389330black beer.jpg

09 Jul 2018 --- Multi-Color Corporation (MCC) and Talkin’ Things are the first Internet of Things (IoT) packaging platform providers to combine Augmented Reality (AR) and Near Field Communication (NFC) technology to create a “unique” customer experience in connected products, according to Talkin’ Things. The label of Black Red Ale beer, which incorporates a large “talking” skull, fully fits into the smart packaging trend by using advanced AR facial recognition and dynamic scenarios dependent on users’ emotions.

NRC is a set of communication protocols that enables two electronic devices, one of which is often a portable smartphone, to establish communication and AR is the interactive experience of a real-world environment, which has been “augmented” digitally.

Click to EnlargeAs the customer scans the smart label with a mobile app, the skull presented on the label engages in an interactive dialogue with the consumer. The facial recognition feature detects if the customer is happy or sad and customizes the next part of the dialogue to accommodate a flowing conversation. Furthermore, variable AR scenarios are also launched depending on answers provided to questions asked by the skull.

“Thanks to our labeling production capabilities and Talkin’ Things technology combined with creative services, we are able to offer our clients a brand new solution that will completely transform a product and change the way end-customers interact with it,” says Craig Miller, President of NA CPG at Multi-Color.

Additionally, NFC smart label applied to the bottle’s neck provides a proof of purchase solution for 2-stage communication with end-customers. It recognizes when the product has been opened to provide different messages to the customers.

Digitalization, the new trend?
Talkin’ Things is a company that “transforms traditional products using digital technology.” The use of digital technology in the packaging sector is booming, with interactive, digitalized labels popping up in all sections of the grocery aisles.

IoT and packaging technology are expected to continue connecting for enhanced customer experience as well as food safety. The NFC used by the Black beer brand demonstrates a potential move away from the use of QR codes that have been used by brands for years. NFC as integrated into packaging, such as on the Black beer bottle, makes it even easier for consumers to access the digital aspect of the packaging and offers a richer experience.

Cameron Worth, Founder of London-based IoT agency, SharpEnd, describes NFC as “the Click to Enlargedominant technology and the one with the brightest future.” He tells FoodIngredientsFirst: “Both Apple and Android are carrying NFC capabilities within their handsets and this is a good mark towards the popularization of this technology.”

“I think that the cost of this technology will decrease so much that you will see the Unilevers and Nestlés, who have low priced goods with smaller profit margins, using NFC globally across their brands,” says Worth.

“Right now consumer awareness of what to engage with and why is still at an early stage, but the more brands that are coming to market with connected packaging programs the greater the consumer awareness of the technology will be,” he adds. 

“In five years’ time it’s going to be a very normal action the same way its normal to tap your debit card on to a reader without using a pin – I think the same sort of normalization of behavior will occur interacting with products via your mobile.”

FoodIngredientsFirst has previously reported on the tequila brand, Jimador, which also uses NFC in its digital marketing labels. Jimador enhanced its summer soccer marketing scheme with “smart” bottles and “connected” coasters, in collaboration with Thinfilm. 

The digitalization of taste has even taken the subjective world of flavor by storm with the digitizing of taste and sensory communications to reduce cost and increase efficiency for supplier and formulators. 

By Laxmi Haigh, with additional reporting by Joshua Poole

This feature is provided by FoodIngredientsFirst's sister website, PackagingInsights.

To contact our editorial team please email us at

Related Articles

Food Ingredients News

Weekly Roundup: Nestlé highlighted in Bloomberg Gender-Equality Index, Louis Dreyfus to exit dairy business by mid-year

18 Jan 2019 --- This week, Nestlé became part of the 2019 Bloomberg Gender-Equality Index (GEI), which distinguishes companies committed to transparency in gender reporting and advancing women’s equality in the workplace. Science and technology company Merck received a 2018 Life Science Industry Award for its “best use of social media.” Meanwhile, Louis Dreyfus is set to exit the dairy business by mid-2019 as part of strategic refocus on its core businesses, while Lindt & Sprüngli achieved solid sales growth and substantial market shares in 2018.

Food Ingredients News

Tracking provenance and building trust: WWF and BCGDV take traceability to next level with new blockchain platform

17 Jan 2019 --- A new blockchain platform promises to take food transparency to the next level by allowing consumers to easily track the provenance of what they are buying while helping businesses stamp out unscrupulous operators. OpenSC can reportedly help businesses to remove illegal, environmentally-damaging or unethical products from their supply chains, giving consumers “peace of mind” about the products they are purchasing. The new platform, launched by WWF and BCG Digital Ventures (BCGDV), comes as more consumers want to know what’s in their food and where it comes from.

Food Ingredients News

US-China trade relations remain “the biggest millstone around the neck,” says new Rabobank F&A outlook

15 Jan 2019 --- The food and agribusiness sector in China will continue to be volatile throughout 2019, according to the latest RaboResearch China Food and Agribusiness (F&A) Outlook 2019. The sector is facing a slowing economy beset with uncertainties and headwinds, the report notes.

Food Ingredients News

Beyond dairy: Chobani launches new plant-based recipe for US market but advocates EU non-dairy labeling rules

14 Jan 2019 --- US yogurt maker Chobani LLC has launched the company's first-ever plant-based non-dairy recipe products which only contain natural ingredients, are low in sugar and are packed with probiotics. By entering the non-dairy space, the company, which spearheaded the US mainstreaming of Greek yogurt, is seeking to capitalize on consumers’ growing interest in plant-based alternatives to products traditionally derived from animal proteins.

Food Ingredients News

“Digital nose” partnership: IFF and Aryballe collaboration holds flavor application potential

09 Jan 2019 --- International Flavors & Fragrances Inc. (IFF) has established an industry-exclusive collaboration with Aryballe, a digital olfaction technology company based in Grenoble, France. The partnership seeks to refine and further develop the flavor and fragrance capabilities and applications of Aryballe’s technology in portable, universal odor detection sensors.

More Articles