Blog Post

Digital Twins and Digital Doubles: Populating our Virtual Worlds

Tom Campbell, PhD; Founder & President; FutureGrasp, LLC • Sep 07, 2018
Like what you read? CONTACT FutureGrasp for more information, speaking engagements and/or collaboration


Digital Twins

Years ago when I worked in the semiconductor crystal growth industry, we had a frequent problem with crystal defects that occurred, seemingly at random, during a multi-day growth process. These defects caused total failure of the greater than $80,000 single crystal. One of my proposed solutions was to create a dynamic computer model of the whole system. The simulation would run simultaneously with the real system’s control settings and model in real-time the various potentials for defects well in advance of their occurring. The closed-loop SCADA [1] system would then make appropriate corrections to avoid defects and yield a perfect crystal. While theoretically possible, my proposal was unfortunately ahead of its time in terms of the compute power and sensors required vs. those available in the early 2000’s.

Fast forward to today, and this concept is called a ‘digital twin,’ defined as “a virtual model that is essentially the intelligence counterpart to an actual, physical object.” [2] Now digital twins are becoming relatively common - “Gartner predicts that by 2021, half of large industrial companies will use digital twins, resulting in those organizations gaining a 10% improvement in effectiveness.” [3]

Digital twins rely on three main components: data (from sensors in the Internet of Things, IoT); a ‘digital thread’ that relays information to the digital twin [4] ; and computation (from artificial intelligence, AI). Fortunately, all three are now up to snuff enough to enable useful applications of digital twins. For example, in the oil and gas industry, predictive maintenance via digital twins offers tremendous benefits:

“The digital twin is a system of systems based on a virtual digital copy of all the infrastructure assets as represented by Deep Learning Neural Networks (DNNs). DNNs are a Machine Learning technique that brings us a new paradigm of ‘software that writes software’ and acts as a compiler for your data to deliver the desired outcome…There is no doubt that smarter, faster, AI-powered applications and digital twins can have a fundamental effect on predictive maintenance in the oil & gas industry, but it will also pave the way for AI and GPU infrastructure enabled edge-to-cloud capabilities to enable full-stream outcomes for production optimization, automated drilling and even bridging the silos across all the operational streams from oil exploration and extraction to processing and distribution.” [5]

While industrial systems may be relatively straightforward to simulate, could we advance this concept dramatically to simulate a living human, thereby creating a ‘digital double’? What benefits and applications might be created if we have a virtual simulacrum of ourselves with all our knowledge, health status, personality quirks, and worldviews? With faster compute, increasing volumes of data, the creation of multi-purpose platform apps, and artificial intelligence (AI), we are getting close to realizing digital doubles. The implications could be profound.

Platform Apps

In the fiction book, “The Circle,” by Dave Eggers [6] , a single company becomes the mashup equivalent of Google, Facebook, Amazon and sundry other companies in its effort to “close the circle” and obtain total digital control and transparency among all global citizens. The book resonated with many people in the technology community, as it is not a far cry from what we see already in China and Silicon Valley.

A close real equivalent to the fictional company Circle is the Chinese firm WeChat (developed by Tencent), which is simultaneously a messaging, social media and mobile payment digital platform. As of March 2018, WeChat has over 1 billion users. Moreover, it is close to being a dominant platform for mobile users – “Chinese users spend approximately one third of all their time on mobile in WeChat.” [7] WeChat is in the vanguard of multi-app consolidation and control.

As with WeChat, the past decade has seen the emergence of platform apps with many capabilities all packaged under a single user-login. Facebook, Amazon, Alibaba and Google are paradigms of what software companies can become through strong programming and rapid absorption of their competition. Apple (iPhone), Samsung (Galaxy), and Google (Android) show what hardware firms can accomplish by stuffing ever more AI processing power into a smartphone. By becoming go-to platform apps, these companies have positioned themselves as five of the top ten – Apple, Amazon, Alphabet, Microsoft and Facebook - in market capitalization listings. [8]

Thus, the trend is clear toward continuing consolidation of capabilities under a handful of umbrella app platforms. The full manifestation of this app-merging would be for each of us to get a digital double – “virtual models of ourselves that will interact with each other in countless simulations to help us make faster, more informed choices in our daily lives.” [9] Such virtual humans would offer significant benefits.

Digital Doubles

In a recent article in Scientific American , Pedro Domingos expounds upon what he sees as a trend in the AI community toward the digital double. Prof. Domingos researches what he dubs the “Master Algorithm,” [10] a fusion of deep learning, symbolic learning, evolutionary algorithms, analogical methods and Bayesian learning. Promises for the Master Algorithm’s benefits are significant:

“Once we attain the Master Algorithm and feed it the vast quantities of data each of us produce, artificial intelligence systems will potentially be able to learn very accurate and detailed models of individual people: our tastes and habits, strengths and weaknesses, memories and aspirations, beliefs and personalities, the people and things we care about, and how we will respond in any given situation. That models of us could essentially predict the choices we will make is both exciting and disquieting.” [9]

An important step for digital doubles is to create seamless voice communications. Several forward-thinking digital companies have marketed voice-activated systems. Apple voices Siri; Microsoft offers Cortana; and Amazon gives us Alexa. While still far from perfect, with more data and continuous improvements in compute, the time will come soon where it will be normal to have a conversation with a computer.

But voice is only one component of a digital double—even more critical is the modeling of an actual person. A few companies are leaders in this space. IPsoft offers the digitized human of Amelia, which possesses cognitive learning abilities, autonomic task management, and emotional intelligence. Amelia services a range of industries like banking, insurance and healthcare to remove much of the drudgery of customer assistance. [11] The company Oben “is building a decentralized AI platform for Personal AI (PAI), intelligent 3D avatars that look, sound, and behave like the individual user.” One can then use that avatar to perform tasks that one may not have time for or would rather not execute. [12]

What might be some applications for a digital double? Let’s review some possibilities.

· Communications – Digital doubles would have the capacity to chat with each other. Suppose you’re planning a party and want to invite all your best friends. You tell your digital double to contact all their digital doubles and arrange the date, time, who brings what, etc. All the knowledge of your friends' calendars, likes/dislikes, and anything else that might affect the outcome of the event could be considered in the virtual world and then brought into reality at the big event.

· Travel – Your virtual persona could be the ideal travel agent. It would know what you prefer to do, where you want to visit, your comforts and discomforts, and really anything else that might affect your personal travel. Moreover, it could navigate all those multiple apps for booking your airline flight, hotel room, rental car, tickets, etc. It could even help you take and choose which photos to post later in social media.

· Knowledge Acquisition – Instead of typing into Google to find that random factoid you want to know, if you have a digital double you could just ask them. With full internet access, your digital double would be able to find any piece of information you’d want within milliseconds. Knowing your interests in great detail, your digital double could also suggest additional information beyond the original search.

· Healthcare – A Holy Grail for a digital double would be to have it mimic essentially the entire human body, in all its nuances. This might be the last stage of the development of virtual self-avatars, as the complexity of the body (37.2 trillion cells in the human body [13] , 100 billion neurons in the human brain [14] ) would challenge even the most advanced supercomputers of today. Nevertheless, we could make basic simulations of the body in digital doubles and thus aid doctors in diagnosing diseases, optimizing nutrition, and assisting in exercise.

Conclusions

Industry already leverages digital twins to streamline equipment maintenance, identify potential part failure modes, and automate more of its processes. The capabilities of digital twins will only improve with better sensors, faster cloud and edge computing, and ever-improving AI.

Will society take the next step and simulate actual humans in the form of digital doubles? I believe it is inevitable. Many of us already have a substantial digital presence, whether in Facebook, LinkedIn, Twitter, WeChat or other social media sites. We spend increasing amounts of time online. A next step for our digital lives would be to create digital doubles that know the most intimate details of us. Benefits for those with a constantly learning virtual self-avatar could be substantial.

As we move into the future with more advanced compute and exponential data availability, there will be an inexorable push to simulate more of our world. Populating our digital worlds with digital twins and digital doubles will ultimately serve us greatly in our increasingly complex real worlds.

Notes (all links accessed September 2018)


[1] Supervisory control and data acquisition

[2] “Using AI, IoT and Big Data to Deliver Digital Twins,” September 2, 2017, https://insidebigdata.com/2017/09/02/using-ai-iot-big-data-deliver-digital-twins/

[3] C. Pettey, “Prepare for the Impact of Digital Twins,” September 18, 2017, https://www.gartner.com/smarterwithgartner/prepare-for-the-impact-of-digital-twins/

[5] P. Modi, “How AI Is Providing Digital Twins For Predictive Maintenance In Oil And Gas,” June 21, 2018, https://www.forbes.com/sites/nvidia/2018/06/21/how-ai-is-providing-digital-twins-for-predictive-maintenance-in-oil-and-gas/

[6] D. Eggers, “The Circle,” 2013, Alfred A. Knopf & McSweeney’s Books, San Francisco, https://www.amazon.com/dp/B00EGMQIJ0/ref=dp-kindle-redirect?_encoding=UTF8&btkr=1

[7] M. Brennan, “One Billion Users And Counting -- What's Behind WeChat's Success?,” March 8, 2018, Forbes, https://www.forbes.com/sites/outofasia/2018/03/08/one-billion-users-and-counting-whats-behind-wechats-success/#57ecfb57771f

[8] “The Largest Companies By Market Cap (100),” http://www.symbolsurfing.com/largest-companies-by-market-capitalization

[9] P. Domingos, “Our Digital Doubles,” Scientific American, pp. 88-93, September 2018.

[10] P. Domingos, “The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World,” 2015, Basic Books, New York, NY, https://www.amazon.com/dp/B012271YB2/ref=dp-kindle-redirect?_encoding=UTF8&btkr=1

[13] E. Bianconi, et al., “An estimation of the number of cells in the human body,” July 5, 2013, Annals of Human Biology, https://www.tandfonline.com/doi/abs/10.3109/03014460.2013.807878

Like what you read? CONTACT FutureGrasp for more information, speaking engagements and/or collaboration
Diplomacy turmoil in age of coronavirus
By Thomas A. Campbell, Andrew Hyde, Geoffrey M. Odlum, Ariel Ahram 11 Jun, 2020
The coronavirus pandemic has utterly transformed international diplomacy. Statecraft has long been driven by face-to-face interactions that expand through informal mechanisms, such as body language, spontaneous conversations, and an understanding of the views of other actors beyond rote statements of positions. Such meetings are now difficult if not impossible in the era of social distancing and work from home mandates. Meetings postponed or canceled altogether have slowed a range of negotiations while many important international conferences have also been delayed or gone virtual. Cybersecurity risks have amplified as unsecure networks are leveraged for conversations that would have normally occurred face to face. Diplomats must find new ways to work in this pandemic era, as well as what the current turmoil in operations may mean post-COVID19. The practice of diplomacy has always been intertwined with state-of-the-art methods of information and communications technology (ICT). For example, telegraphy revolutionized the practices of diplomacy by accelerating the speed of communication between embassies and the metropole. The internet has had similar revolutionary impact on the practices of statecraft and diplomacy. Web-enabled ICT multiplied the number of voices and interests involved in international policymaking; complicated international decision-making; reduced exclusive control of States in the process; accelerated and freed the dissemination of information, accurate or not, about any issue or event; and enabled traditional diplomatic services to be delivered faster and more cost-effectively, both to ones’ own citizens and government, and to those of other countries. Following the development of social media, multiple government agencies are now avid posters on Twitter and other platforms in their attempts to shape public discourse at home and abroad. _________ TURN TO TURMOIL The novel coronavirus has imposed suddenly a full-court-press for diplomats to take to internet ICT, but accompanying this rapid change are new communications stresses and nuances. The functionalities and efficiencies of diplomatic ICT - including phone, email, social media messaging, and virtual meetings – are now routinely in question. The limitations of video-conferencing and other ICT-driven modes of communication have long been documented . U.S. Foreign Service Officers (FSOs) are specifically trained in face-to-face interactions and talking to groups. Exclusive reliance upon teleconference platforms such as Zoom and WebEx affect multiple core capabilities of the FSO. It is difficult to detect and project desired body language, thus introducing challenges in convincing foreign interlocutors to share private thoughts and intentions over a monitor. Negotiations are both enabled and constrained online, thus pushing the dialogue in sometimes unexpected directions. Reduced or no travel, fewer in-person meetings, and overall, limited personal interactions compromise statecraft. Video engagement changes how information and intelligence is collected, thus impacting institutional memory. Diplomatic activity and initiatives have slowed considerably as many major meetings and conferences have gone online, with others outright canceled. US Government agencies have suspended many pre-pandemic priorities and pivoted almost entirely to focusing now on coping with the virus. Security in the White House has increased with individuals working near POTUS being given daily coronavirus checks , thus self-limiting the frequency of high-level meetings. Intelligence officers at the CIA are working shifts , such as three days on followed by three days off, to improve social distancing by reducing the given number of people in buildings at any given time. In New York City, itself a pandemic epicenter, all aspects of life have been severely compromised for over a month now, detrimentally affecting United Nations Headquarters operations and activities. For example, COVID-19 has prompted changes in the working methods of the UN General Assembly : “Physical distancing and stay-at-home restrictions mean representatives can no longer meet in person, including to vote on resolutions, which are now circulated under a process known as ‘silence procedure.’ Ambassadors are given a 72-hour window to consult their capitals. If they all agree on a resolution, it is passed. If not, the resolution is not adopted as the ‘silence’ has been broken.” Webinars and online meetings are the new norm, but they impact the large-scale and often slow-moving collaborative work of drafting and editing of diplomatic agreements and statements. These processes now often involve dozens of people all working remotely using a "track changes" mode of interaction. But direct contact and interaction often undergird these collaborations, as interlocutors know each other and can converse face to face before they move into the web environment. Going straight to the web without initial constructive in-person discussions in the best case merely compromises the speed of production; in the worst case it stymies it entirely. Cybersecurity risks increase when executing all diplomacy online. A singular reliance on ICT raises new questions about the reliability and vulnerability of networks to disruption or espionage; unpreparedness opens new cyber-attack vectors for hackers, both amateurs and State-sponsored professionals. Governments may not have the requisite cyberinfrastructure and trained employees to seamlessly continue diplomacy operations from home offices. Sharing of sensitive documents either cannot be done at all, or only in a limited manner. Diplomatic online sessions can be recorded and played back with deep analyses of verbatim words and body language – normally hurried notes taking and brief summarizations are what constitute the record for face-to-face conversations. Since different organizations and different countries can adopt disparate and non-interoperable technological approaches, ICT compatibility confusion throws additional barriers at smooth statecraft. Some diplomats may avoid negotiations altogether because of security concerns, thus compromising statecraft progress in general. _____________ ACCESSING THE ADVANTAGE State engagements must continue apace regardless of the pandemic. Negotiations of peace, non-virus global health issues, human rights, climate change, nuclear nonproliferation, and trade all must occur, in whatever limited way. Embassies need to find ways to provide emergency consular services to visiting or expatriate citizens in need without putting diplomats at risk of infection. Diplomats face challenges in assessing emerging political, economic, and social trends when prevented from face-to-face meetings or travel around a country. National elections scheduled during this period of social distancing may take place without the confidence-building presence of foreign election observers, increasing potential for corrupt or anti-democratic practices to alter election outcomes. Diplomatic professionals will have to consider how the new online reality impacts their ability to advance their national interests, to understand rapidly shifting geopolitical events, and to reach publics overseas. Key is to understand how diplomacy morphs into a new normal in the coming months and years, and to identify means that diplomats and senior policymakers can prepare. Tactical challenges are to identify best ways of doing business and to implement them in real time during the pandemic. Strategic challenges are to consider how diplomacy following the pandemic might inalterably change, what new opportunities are present, and how to position diplomats accordingly. Advantages and opportunities exist in this new online reality, nevertheless. Frictionless meeting logistics with accompanying financial savings for internet-only engagements; increased opportunities to hear directly from key players; younger diplomats shining with their greater digital skills – all these and more are coming to light in the pandemic era. As stated by the United Nations’ Under-Secretary General for Political and Peacebuilding Affairs, Rosemary DiCarlo , “Although we recognize that the limitations of the processes in which face-to-face meetings are restricted, the increased use of technology has the potential to create new opportunities [and] enhance the inclusivity of peace processes - for example, including the participation of women and young people.” Concomitant with this new reality is the increased potential to leverage big data, predictive analytics, and other digital technologies. Investments should be amplified in artificial intelligence (AI) to analyze all data that can be extracted on any given country, region, or topic. Predictive analytics using machine learning (and its subset, deep learning) can then be applied to offer novel insights for meeting preparedness and briefings to senior policymakers; such approaches offer new opportunities in optimized human-machine hybrid decision-making. AI can also be used to automatically assess treaty compliance, as well as to monitor and predict events before they occur . In-situ machine language translations and real-time content assessment for both verbal and written communiques are feasible now. Increased security of voting processes via blockchain holds great potential. Virtual reality avatars can be applied to replicate the feeling of sitting across a table from a counterpart. Ultimately, there is a wide range of technological applications and solutions that await adoption and deployment by forward-leaning diplomatic corps. However long the pandemic lasts, diplomacy has been forever changed. How diplomats respond to the recent step-change in personal interactions and resultant altered statecraft will dictate whether national objectives are met, whether treaties are negotiated, and whether normal operations return - or diplomacy turmoil continues. The opinions and characterizations in this piece are those of the authors and do not necessarily represent those of the U.S. Government. Thomas A. Campbell, Ph.D. (tom.campbell@futuregrasp.com) is Founder & CEO of FutureGrasp, an advisory group that works with organizations globally to identify policy and business opportunities from emerging and disruptive technologies, especially artificial intelligence. Previously, he was the first National Intelligence Officer for Technology with the National Intelligence Council, Office of the Director of National Intelligence (ODNI). Andrew Hyde (andrew.hyde@futuregrasp.com) is a Nonresident Fellow at the Stimson Center, a Washington, D.C. based think tank, with the Transforming Conflict and Governance Program, and a Senior Advisor with FutureGrasp. Previously, he was a Foreign Service Officer at the U.S. Department of State and a Congressional staffer. Geoffrey Odlum (geoffrey.odlum@futuregrasp.com) served as a Foreign Service Officer at the U.S. Department of State from 1989 to 2017. He is currently the President of Odlum Global Strategies, a national security and technology policy consulting firm, and is a Senior Advisor with FutureGrasp. Ariel I. Ahram, Ph.D. (ahram@vt.edu) is Associate Professor and Chair of Government and International Affairs (GIA) at the School of Public and International Affairs, Virginia Tech.
By Thomas A. Campbell, Ph.D. 04 Apr, 2019
It is the position of FutureGrasp, LLC that every nation state should have an AI national plan. To remain economically competitive internally, as well as to facilitate collaboration across borders, it is imperative that governments recognize the need to channel whatever resources they possess to produce plans that enable strategic directions in the rapidly growing technology sector of AI.
By Tom Campbell, PhD; Founder & President; FutureGrasp, LLC 10 Aug, 2018
It is often said that history repeats itself—we are seeing these same trends today with autonomous weapons.
By Tom Campbell, PhD, Founder & President, FutureGrasp, LLC 20 Jul, 2018
We offer here a review of several facets of artificial intelligence (AI) that could benefit or compromise law enforcement (LE). As AI becomes more advanced, the potential for its application by LE experts (and criminals) will only increase. Let us hope that LE officers in the field and analysts in the office are able to leverage AI to protect people around the world.
By Tom Campbell, Founder & President, FutureGrasp, LLC 19 Jun, 2018
Voice is all the buzz (no pun intended) in Silicon Valley. Many technology leaders (Apple, Amazon, Microsoft, etc.) are betting that verbal commands will soon be the major means of communication for our numerous devices. But is verbal chatter the terminal point for our computer communications?
By Thomas A. Campbell, Ph.D., FutureGrasp, LLC 04 May, 2018
Quantum supremacy, the point at which a quantum computer exceeds the capabilities of any classical computer , is now near at hand. I explain why and what that means for computer science.
By Thomas A. Campbell, Ph.D., FutureGrasp, LLC & Robert Meagley, Ph.D., nR, LLC; ONE Nanotechnologies LLC 08 Feb, 2018
We review the state of the art in advanced semiconductors as relevant to artificial intelligence (AI).
By Thomas A. Campbell, PhD, FutureGrasp, LLC & Robert Meagley, PhD, nR, LLC 02 Feb, 2018
We review the state of the art in advanced compute architectures as relevant to artificial intelligence (AI).
By Thomas A. Campbell, Ph.D., FutureGrasp, LLC & Matt Wolfe, Ph.D., Virginia Tech Applied Research Corporation (VT-ARC) 09 Jan, 2018
We review the challenges to qualitative forecasting of science and technology, and detail the advantages to taking a more quantitative approach using big data analytics and AI.
By Tom Campbell 04 Dec, 2017
The only way we can survive and thrive in this constantly changing and increasingly complex world is to get assistance from our machine creations. Artificial intelligence (AI) must be a core aspect of that help, as it offers unprecedented capabilities to monitor, control and assess a wide range of situations. AI will not (at least in the near term) remove the human from the loop; instead, it will augment our capacities for better data collection, analysis and decision making.
Show More
Share by: