The Art of War is attributed to the ancient Chinese military strategist Sun Tzu and remains the most influential book in East Asian warfare and Western cultures. This book explains Chinese military tactics, from strategy and weapons to rank, discipline, and training techniques. What is truly unique is that Sun Tzu wrote this book in the 5th century BC.
During the Sengoku period (c. 1467–1568), the Japanese daimyō named Takeda Shingen (1521–1573) became almost invincible in all battles without relying on guns because he studied The Art of War. The book even gave him the inspiration for his famous battle standard “Fūrinkazan” (Wind, Forest, Fire, and Mountain), meaning fast as the wind, silent as a forest, ferocious as fire, and immovable as a mountain.
Virtualization of data is the new art of war. Virtualization is the ability to join data no matter where it resides without any technical expertise, and it makes your organization fast, ferocious, and movable.
Why are companies spending millions of dollars migrating and taking years to do so when they can spend thousands and do it immediately? Why not have on-premises systems with cloud platforms and join the data across platforms?
The technology is here right now. How do I know? I invented it. It only took 20 years, but as Thomas Edison once said about building the lightbulb, “I have not failed. I’ve just found 10,000 ways that won’t work.”
Tom Coffing, the world’s leading expert on Virtualization, is having a webinar this Thursday, January 21st, at 1:00 EST to demonstrate Virtualization live.
I will show off my invention with my partners, Yellowbrick and Sotero, so please sign up for the webinar tomorrow at the end of this blog.
My journey to building the perfect software giving businesses an advantage to implement an Art of War strategy on their customers, begins by overcoming obstacles that we all face in the data industry.
Above, the picture shows the Nexus Server connecting to Nexus Pro Desktops. The users point-and-clicks to move or join data, and the Server does the work for the user.
The first obstacle is creating a user-friendly query tool that can simultaneously query every single database platform on the market. It is of great challenge to build a query tool for a single database, let alone one that works across all platforms. The one positive is that all database platforms can use SQL as a query language.
The next obstacle is converting table structures and data types between databases. The possibilities are endless, and even the best data scientists have spent 30 days converting 30 tables between systems. No matter what two databases a user selects, 30 tables need to convert in 30 seconds. With my Nexus Desktop and Server combination, you can instantly move thousands of tables between any two database platforms.
One of the most challenging obstacles is moving data across networks, requiring mastering the load utility languages from each vendor, automating over 100 different ways to transfer data, equivalent to an individual learning 100 other languages and speaking them fluently.
If by chance, you have the wherewithal, the tenacity, and the funding to overcome these challenges, you are only halfway there. You now need to provide a graphical user interface that visually shows tables. When the user checkmarks the columns for their result set, they want the SQL to build automatically. Automating SQL building itself is problematic because although database platforms use SQL, the millions of tiny differences are a burden that must overcome.
The easy part is building a tool that can query all systems, convert table structures and data types in seconds, master each vendor’s load utility language, show tables visually, and automate SQL building. You must now bring it all together with two pieces of genius that make the impossible possible.
The first piece of genius is to allow cross-system joining of data by combining all previous accomplishments. Still, it would help if you enable the user to process the join on the system where it makes the most sense. Data comes in all sizes, so processing the join is not a one size fits all scenario. The user must have the option of joining the data on any on-premises database system, cloud system, an available server, or on their PC or laptop. We call the processing of choice system the Hub.
Now that your invention is nearing the peak of Mt. Everest, you realize that your decades of work is for naught if you cannot overcome the last challenge. The positive news is that you have overcome many obstacles to allow a user to point-and-click to move data across platforms to join. But what is the bad news?
The bad news is that when a user commands data to move from their PC or laptop, data must flow through that same PC or laptop. The data flows from the source system through the PC and onto the target system, killing any idea of moving large amounts of data. The user is often outside of the company firewall working at home or on the road, which means the data path is a local area network on a PC with minimal memory.
There is only one path forward, and the solution becomes clear. You must allow the user to do everything from their PC or laptop, but you must provide an option to let a Server initiate and execute the work on a high-speed network. This Server is to the data highway what a cell tower is to a cellphone.
It took almost five years to develop the coordination between the user’s workstations and the Server. Still, now a company can place multiple Servers on-premises and on every cloud—the closer the Server to the database platforms, the faster and more efficient the flow of data.
And that is how the most incredible tool in data was born. The names are the Nexus Pro Desktop and the Nexus Server.
It no longer matters where the user is working from or where the data resides. The user points-and-clicks and a single button press can join billions of rows across dozens of systems on a data highway built for speed.
Virtualization is the future of data, and some companies will find benefits nearly a billion dollars!
I have a partnership with two leaders in the industry that put the icing on the cake. Soterosoft is the leader in encrypting sensitive data, which allows a company to provide access across a universe of data but protecting sensitive data.
The other vital component is my partnership with Yellowbrick, which has the most modern data warehouse technology today. Yellowbrick provides a database with blistering performance, works on-premises or on any cloud, moves data at world-record speeds, and can have thousands of users query billions of rows in subsecond time. The Yellowbrick advantage brings a Virtualization Hub to an entirely new level.
I recently did a webinar on Data Migration and Virtualization with Yellowbrick, and the recording link is below. You can skip to 10 minutes 25 seconds to see the Nexus portion of the demo.
Tom Coffing, better known as Tera-Tom, is the founder of Coffing Data Warehousing where he has been CEO for the past 25 years. Tom has written over 75 books on all aspects of Teradata, Netezza, Yellowbrick, Snowflake, Redshift, Aurora, Vertica, SQL Server, and Greenplum. Tom has taught over 1,000 classes worldwide, and he is the designer of the Nexus Product Line.