diniscruz.ai / writing / Knowledge Graphs

Empowering the Graph Thinkers in the Age of Generative AI

By Dinis Cruz and ChatGPT Deep Research · · 36 min read

PDF LinkedIn post

Contents · 9 sections
  1. Introduction
  2. The Challenge for Graph Thinkers
  3. The Rise of GenAI and No-Code Solutions
  4. LLMs as Ephemeral Graph Databases
  5. Memory-First Graph Databases and Serverless Architecture
  6. Applications: From Business Processes to Personal Knowledge Graphs
  7. Collaboration: Graph Thinkers and Traditional Developers
  8. Benefits and Future Outlook
  9. Conclusion

Introduction

In a world increasingly defined by complex interconnections, a unique set of individuals thrives on seeing relationships and patterns everywhere – the "graph thinkers." These are people who intuitively view information as networks of nodes and links, believing that “everything is really just graphs and maps”. Graph thinkers can mentally connect disparate concepts across business functions, technology stacks, or even social systems into coherent knowledge graphs. Historically, however, many of these creative minds have been constrained by the limitations of technology and coding skills. Realizing a vision that “everything connects to everything” often required heavy technical implementation, dedicated development teams, or costly graph database infrastructure – resources that were out of reach for most individual innovators.

Today, recent advances in Generative AI (GenAI) and no-code development tools promise to change this landscape. Large language models (LLMs) and AI-assisted development platforms are democratizing the ability to build sophisticated applications without traditional programming. In particular, GenAI is enabling a new paradigm: using LLMs as ephemeral graph databases to create and manipulate knowledge graphs on the fly. This white paper explores how individuals who “think in graphs” can leverage generative AI and modern graph technologies to finally implement their visions at the speed of thought, without being blocked by the historical barriers of coding or rigid software tools.

We will discuss the challenges graph thinkers faced in the past, the emerging opportunities with LLMs as graph engines, and the open-source innovations (such as MGraph-DB and serverless semantic knowledge graphs) that are paving the way. In doing so, we aim to provide a roadmap for graph thinkers – and the organizations that stand to benefit from their insights – to harness GenAI in building dynamic, living knowledge structures. The result is a democratization of innovation: anyone with a graph-oriented mindset can now turn ideas into tangible models and applications, fostering creativity and problem-solving in areas from business process mapping to enterprise knowledge management.

The Challenge for Graph Thinkers

Graph thinkers are a rare but valuable breed of innovators who naturally view problems through the lens of relationships and networks. Rather than thinking in isolated silos or linear processes, they see webs of interdependence: in their eyes, “everything is a graph” connecting to everything else. This cognitive style can be applied to countless domains – from linking components of a business strategy, to mapping software system architecture, to understanding cause-and-effect in social or security contexts. Such individuals excel at envisioning holistic models of complex systems. For example, a graph thinker in cybersecurity might connect vulnerabilities to systems, systems to business impacts, and threats to mitigations in one mental map, revealing insights that a linear list would miss.

However, turning these rich mental graphs into reality has historically been frustrating and difficult for those without strong programming abilities. In the past, an individual might sketch an intricate concept map on a whiteboard, only to hit a wall when trying to implement it in a software tool or database. Traditional development processes were too slow and rigid to keep up with the exploratory, evolutionary nature of graph thinking. When a graph-oriented person handed off their ideas to a software development team, the typical question from the developers – “tell us exactly what you want built” – was at odds with the graph thinker’s emergent and iterative approach. Before GenAI, unless one was both a graph thinker and a skilled coder, many brilliant ideas remained stuck at the conceptual stage.

Several factors made this so:

These challenges were exacerbated by the state of graph technology itself. Graph databases – specialized databases for storing and querying network-structured data – have been around for decades, but they did not evolve in a way that served individual innovators working on small, rapidly changing graphs. Many graph databases (e.g., Neo4j, Amazon Neptune) were designed to handle massive, enterprise-scale knowledge graphs with fixed schemas. They excel at storing billions of relationships and answering complex queries, but they are heavyweight and inflexible for an individual who wants to spin up a fresh, experimental graph model overnight. Deploying and maintaining these systems required significant infrastructure and expertise, which was impractical for one-off personal projects or fast brainstorming.

Moreover, traditional graph databases assume you have a well-defined schema or ontology upfront – a structure of node and edge types that remains relatively stable. Graph thinkers, on the other hand, often deal with dynamic ontologies that evolve as understanding grows. Imposing a rigid schema too early would be like setting stone before the idea has taken shape. In practice, this meant graph thinkers either had to shoehorn their ideas into existing tools (losing nuance), or give up on using graph databases entirely for lack of agility.

In summary, until recently, the immense potential of graph thinkers was largely bottlenecked by technology. The people who could most benefit from advanced graph modeling were the least empowered to use it. This is where the convergence of no-code development platforms and Generative AI begins to change the game.

The Rise of GenAI and No-Code Solutions

The past few years have witnessed a revolution in how software is built and who can build it. No-code and low-code platforms have lowered the barrier for creating applications by offering visual interfaces, drag-and-drop components, and templates that non-programmers can use. This trend has already started democratizing app development, enabling “citizen developers” to turn ideas into working tools without writing code. But the advent of Generative AI, especially large language models like GPT-4, has supercharged this democratization.

Generative AI (GenAI) models can produce code, text, and structured outputs from plain language prompts. They act as copilots or assistants that understand a user’s intent and generate the necessary logic or content. For graph thinkers, this means an AI translator now exists between their conceptual ideas and the technical implementation. With GenAI, even those with zero programming knowledge can describe what they want in natural language and have the AI produce working code or configurations. As one observer noted, “genAI removes the entry barriers to coding development”, allowing regular users to create software without needing to manually write any code.

Key developments that empower graph thinkers include:

In essence, GenAI acts as the ultimate no-code platform for graph-based development. It brings the speed, flexibility, and creativity that graph thinkers need. Ideas can be tested and visualized almost as quickly as they are conceived. Furthermore, AI assistance helps overcome the knowledge gap – the graph thinker doesn’t need to know the intricacies of graph database query languages, server setup, or programming syntax. They only need to focus on the relationships and logic of the problem, and let the AI handle the execution.

The impact of this is profound: imagination is no longer limited by implementation. A whole class of innovators can now actively build, not just brainstorm. As generative AI matures, we foresee an explosion of custom micro-applications, knowledge models, and decision-support tools built by domain experts who think in graphs – people who previously could not bring their ideas to life due to technical barriers. Studies already indicate that integrating GenAI with low-code platforms leads to more sophisticated and efficient development by non-coders.

However, unlocking this potential requires more than just the AI. There must be an underlying framework to store, manipulate, and visualize the graphs that the AI helps to create. This is where new approaches in graph database architecture come into play, especially the concept of using LLMs themselves as ephemeral graph databases.

LLMs as Ephemeral Graph Databases

One of the most intriguing emerging patterns is to use a large language model as a graph database – not in the traditional persistent sense, but as an ephemeral, on-demand knowledge store. The idea is unconventional: normally, we think of a database as something static and persistent, where data is stored and remains until queried. But with powerful LLMs, we can instead feed the model data and a query in one go, and have it perform complex graph-like reasoning internally, returning the results without ever explicitly storing the full data on disk in a structured database.

In practical terms, treating an LLM as an ephemeral graph database works like this:

  1. Prepare Data as Text/JSON: Start with your raw data – it could be a collection of documents, a CSV of transactions, or a set of statements about a domain. The first step is to convert this data into a prompt-friendly representation. For graph use cases, this often means formatting the data as nodes and edges in text or JSON. For example, one might represent a list of relationships like: NodeA -> NodeB (relationType), or use JSON structures listing entities and their connections. Dinis Cruz’s MyFeeds project, for instance, converted RSS feed articles into a JSON object and then into a tree-structured text that represents the graph of entities.

  2. Load into the LLM via Prompt: Provide the LLM with a prompt that includes both the data (or relevant subset of it) and an instruction (the “query”). Essentially, you are telling the LLM, “Here is a graph (described in text), now answer this question about it or transform it in some way.” Because the LLM has been trained on vast amounts of text (including likely graph-like data structures and reasoning patterns), it can parse the input as a graph and perform reasoning. This could be querying a relationship path, finding clusters, or creating a new node by merging others – all tasks that a graph database could do.

  3. LLM Processes and Transforms: The LLM, within a single prompt-response cycle, acts as the engine that loads the graph (in its neural network working memory), carries out the instructions, and formulates an answer. Importantly, this answer can be structured. For example, you might ask the LLM to “find all connections between X and Y within two hops and return them as JSON edges”. With features like OpenAI’s function calling or structured output schemas, the LLM can output a machine-readable result – effectively the answer subgraph.

  4. Output to Files: The result from the LLM can be saved back to the file system (e.g., as a JSON or CSV file). This could represent a filtered set of relationships, a summary, or any transformed data. Because the output is now on disk, it becomes the input for the next round of processing. In a sense, the file system plus LLM together form a feedback loop: data files → LLM prompt → output files → (back to LLM or user).

  5. Iterate as Needed: The next prompt can take the newly created file (which might itself describe a graph or partial graph) and do further operations. For example, one round might extract an ontology (types of entities and relations), the next round might use that ontology to categorize or filter the graph, and a subsequent round could generate a visualization code. Each step the “graph database” is instantiated fresh in the LLM’s memory from the files, manipulated, and then dissolved after output. Hence, it’s ephemeral – existing only for the duration of each prompt – yet across prompts a persistent result evolves, stored in the series of files.

This approach is powerful for several reasons:

Real-world early examples of this paradigm are emerging. Microsoft Research’s GraphRAG technique is one notable instance where LLMs generate a knowledge graph on the fly for each query to improve question-answering on private data. In GraphRAG, the LLM reads a set of documents and produces a temporary graph of entities and relationships relevant to the question; that graph is then used to fetch answers more effectively than traditional retrieval methods. This underscores that LLMs are capable of performing graph construction and traversal as part of their native functionality. The graph is essentially an ephemeral byproduct of the prompt, not a persisted structure – yet it adds significant value in accuracy and explainability of the AI’s answer.

In summary, using LLMs as ephemeral graph databases opens up a new flexible workflow for graph thinkers:

This workflow was practically unheard of a few years ago. It’s a direct result of LLMs reaching a level of sophistication where they can internalize and manipulate data structures based on prompts. It shifts the role of the human to curator and conductor of knowledge, rather than coder or database administrator. The graph thinker describes what they want, and the LLM does the rest, one ephemeral graph at a time.

Memory-First Graph Databases and Serverless Architecture

While LLMs themselves can act as ephemeral data stores, there is also a complementary development in the world of graph databases that perfectly aligns with the needs of graph thinkers: memory-first, serverless graph databases. One such open-source innovation, developed by Dinis Cruz and collaborators, is MGraph-DB (also referred to as MGraph-AI) – a graph database designed from the ground up for GenAI applications and serverless environments.

MGraph-DB takes a fundamentally different approach from traditional graph databases:

In practice, tools like MGraph-DB empower graph thinkers to set up their own graph sandbox quickly. For example, a user could instantiate an MGraph-DB in a notebook or script, feed it JSON data (perhaps extracted by an LLM), perform some in-memory graph analysis or merging, and then dump the results back to JSON. This has been used in projects like MyFeeds.ai, where after extracting entities and relationships via LLMs, the data is merged into an MGraph-DB to facilitate easy combination and manipulation of those JSON objects as actual graph nodes and edges. In that workflow, MGraph-DB acted as the glue that holds intermediate graph data, allowing multiple LLM calls to contribute pieces that are combined into a single knowledge graph.

An illustrative example of this architecture in action is the “serverless semantic knowledge graph” pipeline used for building a news feed knowledge graph. In this pipeline:

This example shows how using cloud storage as a database, combined with ephemeral compute, achieves what a traditional always-on graph database would do – but in a more cost-effective and flexible manner. Each piece of data in the pipeline is an artifact on the file system (S3): raw data, intermediate JSON, final graph, visualization image. A graph thinker could inspect or even manually edit those if needed, or rerun parts of the pipeline easily by invoking the functions.

For open-source graph innovation, MGraph-DB and similar projects represent an important shift. They align with the way graph thinkers operate: load everything in memory (as one would mentally), see it all at once, manipulate freely, then store snapshots. The historical approach of tuning a database for either transactions or giant analytics is replaced by an approach optimized for AI workloads and knowledge exploration. Features like version control of graphs (since diffs can be done on JSON files) and integration with semantic web standards are built-in, acknowledging that graphs often need to represent richly typed relationships (ontologies, taxonomies) and that those representations may change and improve with feedback.

In essence, tools like MGraph-DB provide the scaffolding on which LLM-driven workflows can run reliably. An LLM might generate or update a set of triplets (subject-predicate-object statements) which are then inserted into the MGraph in memory; another LLM call might ask a question whose answer requires traversing the combined graph – that could be handled either by the LLM reasoning or by a query to the in-memory graph via code. The result can be fed back into the next AI prompt or visualized for the user.

The synergy between ephemeral LLM graphs and memory-first graph databases is powerful. The LLM can handle the fuzzier side – extracting knowledge, making connections with guidance in natural language – and the lightweight graph DB handles the deterministic side – ensuring data integrity, providing fast lookups, and storing results. Both are highly complementary in a serverless paradigm: spin them up when needed, tear them down after use, and use simple storage (files) to link stages together.

To summarize this section, the technologies now at the disposal of graph thinkers include:

We now have an unprecedented toolkit for turning mental graphs into living graphs. Next, we look at how these capabilities can be applied to real-world scenarios and the impact that empowering graph thinkers can have in various domains.

Applications: From Business Processes to Personal Knowledge Graphs

The convergence of graph thinking and GenAI-based tools opens up a multitude of impactful applications. Here we focus on a few key areas where graph thinkers, equipped with LLMs and serverless graph tech, can deliver unique value:

1. Mapping Business Processes and Organisational Knowledge

One of the greatest opportunities lies in using graph approaches to model the complex processes and knowledge within organizations. Every company has vast amounts of tacit knowledge – how things really get done, how data flows between departments, who depends on whom for decisions, what the unofficial workarounds are, and so on. Traditionally, capturing this in a usable form has been incredibly hard. It often ends up as static flowcharts, documents, or outdated intranet pages that fail to reflect the real, living system.

Graph thinkers can change this by building semantic knowledge graphs of the enterprise. Using GenAI, they can:

The end result for businesses is a “digital twin” of their knowledge and processes, far more faithful and queryable than any org chart or Confluence wiki page. It can be used for training new employees, diagnosing inefficiencies, compliance checks (tracing data lineage for regulations), and strategic decision support (seeing the ripple effects of a change). For graph thinkers, this is a perfect playground: they get to apply their holistic view to real problems, and now they have the tools to implement it largely on their own. This democratizes what used to require big consulting engagements or enterprise software projects.

2. Personal Knowledge Management and Education

On a personal level, individuals can leverage these techniques to build their own knowledge graphs and learning tools. Imagine a student or researcher who thinks in graphs – they could use LLMs to turn their notes, references, and hypotheses into a graph of interconnected ideas. There are already efforts to use AI for turning unstructured notes into structured graphs (for instance, extracting who-knows-who from a set of historical letters, or concepts from a textbook chapter and how they relate). With an ephemeral LLM graph approach, a learner can:

This could revolutionize study techniques, allowing one to see the “map of knowledge” of a subject rather than just linear notes. It also closely aligns with how graph thinkers naturally learn – non-linearly and by connecting dots across domains.

3. Creative Brainstorming and Innovation

Graph thinkers often excel in creative brainstorming because they can link ideas from different fields. With GenAI, they can amplify this capability:

4. Semantic Web and Linked Data for All

The semantic web community has long advocated for linked data and ontologies to make information more machine-understandable. However, it remained a niche activity often requiring expertise in RDF/SPARQL, OWL, etc. Now, graph thinkers can use GenAI to bridge their informal understanding with formal semantic graphs. For example, they could describe a domain and have the AI generate an ontology (in, say, OWL or a JSON-LD context) that they can refine and publish. The AI can also help align their custom ontology with existing ones by finding matches. Dinis Cruz’s work hints at this, where the LLM is initially allowed to freely define entities and relationships, and later steps involve refining those with more deterministic ontology inputs. This two-step (creative then refining) process can be done by one person with AI assistance, rather than needing a whole committee to agree on standards before any data gets linked.

5. AI Agent Memory and Decision-Making

For those developing AI agents or advanced decision-support systems, having a graph-structured memory is advantageous. An agent that “thinks in graphs” could, for instance, maintain a graph of its observations and use it for reasoning (some projects like Agentic Graphs or memory systems like Zep’s knowledge graphs are exploring this). Graph thinkers could design better AI agents by specifying how information is structured as a graph, and using GenAI to continuously update and prune that graph. This merges human intuition about what concepts are important with the AI’s ability to process large volumes of data.

Collaboration: Graph Thinkers and Traditional Developers

Empowering graph thinkers with GenAI and no-code tools does not eliminate the need for traditional software developers and engineers. On the contrary, it opens up new modes of collaboration. The roles and workflows will adjust in the following ways:

It’s worth noting that developers themselves might become graph thinkers over time, once exposed to these tools. Conversely, graph thinkers might pick up more technical skills since the AI removes the most tedious parts of coding, leaving the more interesting bits accessible. The boundary is blurring – which is in itself a hallmark of the democratization of development.

Crucially, the fear that “AI will replace developers” is reframed here: AI empowers a new class of creators, and developers evolve to higher-level problem solvers and educators within the process. Just as past waves of automation elevated the level of abstraction at which humans operate (assembly code to high-level languages to frameworks), GenAI and no-code elevate us to a more conceptual, design-oriented plane of work. Graph thinkers exemplify that by operating directly at the knowledge model level, and developers ensure those models are realized efficiently and safely.

Benefits and Future Outlook

The confluence of graph thinking and generative AI capabilities is still in its early days, but the trajectory is clear and promising. Here we outline the key benefits of embracing this approach, and what the future might hold:

1. Unleashing Creativity and Innovation: By removing the traditional bottlenecks, individuals who were once sidelined in the creation process can now actively build and experiment. Organizations that encourage their “idea people” or subject-matter experts to use these AI-assisted graph tools could see a surge in innovative solutions. Problems that were previously thought intractable or too costly to address (due to analysis paralysis or lack of engineering resources) might be solved with a small AI-augmented team rapidly prototyping and iterating on a graph model of the problem.

2. Better Decision Making through Explainability: One criticism of end-to-end AI solutions has been the black box nature of results. By incorporating knowledge graphs and intermediate representations, we gain explainability. Each result or recommendation can be traced through the nodes and edges (or the chain of LLM prompt steps) that led to it. In the MyFeeds example, instead of the AI magically picking 5 relevant news articles for a persona, the process involves extracting entities, mapping them to the persona’s interests, and then selecting articles with the highest overlap – with each step documented in JSON and graphs. This way, provenance is built into the system: every statement can be connected back to a source. For businesses, government, or science, such transparency is invaluable. It builds trust in AI-assisted decisions and allows audits and improvements.

3. Adaptive Knowledge Systems: In the future, knowledge graphs created with these techniques will not be static artifacts; they will be living systems that learn and adapt. With human-in-the-loop feedback (graph thinkers or any user correcting or enhancing the graph), and with GenAI continuously processing new inputs, these graphs will update themselves. Dinis Cruz envisions graphs that “evolve and get better the more they’re used”. For instance, if many people query a knowledge graph and frequently correct it or navigate it in certain ways, the AI could suggest reorganizing the graph for clarity, or merging nodes that users often consider equivalent. This turns knowledge management into a dynamic conversation rather than a periodic manual curation task.

4. Bridging Silos and Perspectives: Graphs naturally merge data from different silos. GenAI can take data that was never meant to work together – say, a SQL database of sales figures and an Excel sheet of marketing campaigns – and link them via common entities (like product names or regions). This is often where breakthroughs occur, by seeing a connection between two things that were previously disconnected. On a human level, graph thinking augmented by AI can also bridge perspectives. As described in the “ontologies of ontologies” concept, we can maintain diversity (different teams or individuals have their own way of structuring knowledge) while still achieving unity by mapping between those structures. AI can help automate those mappings and maintain them even as each sub-ontology evolves. The result is a federated but integrated knowledge network – a very powerful notion for large enterprises, research communities, or even global challenges that require interdisciplinary collaboration.

5. New Roles and Skills: We might see the rise of roles like “AI-facilitated Knowledge Modeler” or “Graph Systems Architect” which are essentially what graph thinkers become when formally empowered. These individuals will be adept at prompt engineering for knowledge extraction, using tools like MGraph-DB to refine data, and guiding the overall knowledge strategy of an organization. It’s a hybrid of business analyst, data scientist, and ontologist – but enabled by AI to be far more productive than those roles in the past. Educational programs and training might start focusing on graph literacy and prompt design, recognizing that this combination is a critical skillset in the modern workforce.

Looking ahead, several trends are likely:

Conclusion

The emergence of generative AI as a co-pilot in development has finally opened the door for those who think in graphs to directly bring their visions to life. No longer constrained by the need for extensive coding or by the rigidity of legacy tools, these individuals can now leverage LLMs as both collaborators and engines for graph-based innovation. We have outlined how the synergy of graph thinking and GenAI – supported by memory-first graph databases like MGraph-DB and serverless architecture using simple storage – creates a powerful platform for building semantic knowledge graphs on-demand, iteratively, and at low cost.

The impact of this shift is multifaceted. We will see faster and more transparent problem-solving in businesses as hidden connections are unveiled through AI-generated graphs. We will empower a broader community to engage in knowledge modeling – turning knowledge once trapped in experts’ minds or static documents into living graphs that can be queried, visualized, and improved continuously. In doing so, organizations and individuals become more adaptive and insightful, as they can map and navigate the complexities of their domains with unprecedented clarity.

Crucially, this is a story of democratization. The ability to create sophisticated graph-based solutions is no longer the sole province of specialized software companies or PhD data scientists. A passionate professional with the right mindset and AI tools can achieve in weeks what might have taken a large team months or years in the past. The learning curve for technology is flattening; GenAI is the great equalizer, turning natural language into working systems and freeing creativity from the shackles of syntax and setup.

However, this does not make human expertise any less important – in fact, it elevates the importance of creative and systems thinking. The role of the human shifts to providing vision, context, critical evaluation, and ethical guidance, while the AI handles the grunt work of implementation and data crunching. The most successful outcomes will arise from close collaboration between graph-thinking domain experts and savvy developers, combining conceptual brilliance with technical robustness.

In the coming years, we anticipate a flourishing ecosystem of open-source tools, shared ontologies, and community-driven knowledge graphs, many initiated by individuals empowered by GenAI. Challenges remain – from ensuring data quality and AI accuracy to managing security in AI-driven workflows – but these are surmountable with thoughtful design and collaboration (as we discussed, developers will play a key role in this). The trajectory is clear: knowledge, once siloed and static, is becoming connected and alive.

As we conclude, we circle back to the initial vision: a person who sees connections everywhere can now materialize those connections into a tangible graph, ask "what if?" and get answers, refine their ideas and see them grow, all at the speed of conversation. The walls between imagination and realization are crumbling. In this new paradigm, everything can truly be a graph – and anyone with the passion to explore it can harness that graph for insight and impact.

Sources:

Released under CC BY 4.0. First published on docs.diniscruz.ai; this page as markdown.