AGM Studios Alexander G. Myers

Work · Business systems

How I choose middleware without guessing

I turn a department's pain point into a shortlist with conditions. The sources are logged, dated and hashed.

Context Example XYZ Consulting (fictional): one department double-books clients, another copies the same data between three tools My role I collected the pain points, researched every option, and wrote the evidence behind the recommendation. Tools Crawl4AI, browser automation, Power Automate, n8n, draw.io

Reconstruction. Fictional company and data, built from scratch to show a similar methodology. The original work is covered by a confidentiality agreement (NDA). The real research was a 2026 co-op at a national innovation organisation, listed on my CV.

The problem

Departments rarely ask for middleware. They say things like “appointments get double-booked” or “we copy the same client details into three tools”. The risk is jumping to the tool someone has heard of. The firm then pays for a product that solves the wrong problem, or sends client data somewhere nobody approved.

I turned those complaints into requirements, compared the options that met them, and gave leadership a shortlist with the reasons written down.

How I worked

  1. Collected the pain points from the people doing the work, in their words, with an example of each failure.
  2. Turned them into requirements: the job to be done, the systems involved, the data, and who owns it afterwards.
  3. I asked the questions that narrow the field before looking at any vendor: which platform the firm already pays for, whether data may leave the tenant, and whether anyone can run a self-hosted tool.
  4. I researched in tiers: official documentation and licence pages first, then vendor forums and practitioner reports. I treated contested claims as claims until two independent sources agreed.
  5. I ended with a shortlist with conditions, never a single winner without caveats.

Try the questions

Pick a path: from pain point to shortlist

Answer like the department would. The tree never names a winner, only a shortlist with the conditions to check.

    For a Microsoft-native firm the likely direction is predictable. The point of the tree is the thinking around it: what changes if the firm runs on Google, cannot let data leave, or has nobody to maintain a self-hosted tool.

    The governance screen every option passes

    QuestionIf yesIf no
    Does it touch client, financial or other regulated data?Data-flow map, retention rule, processor terms, owner sign-offContinue
    Can it write or delete records?Test account, dry run, approval step, rollback planContinue
    Can data leave the tenant?Check contract, residency and logging; otherwise self-host or stopContinue
    Can an admin revoke access and export data quickly?Proceed to a pilotReject the option
    Is there an internal owner after rollout?ProceedStop: unowned middleware becomes shadow IT

    Research method, shown on public sources

    For this page, I re-ran the collection step on the vendors’ public pages with the self-hosted crawler on my lab.

    Evidence ledger

    Collected with the lab's self-hosted Crawl4AI on 2026-10-26 00:30 UTC. The ledger records each source's URL, retrieval date and a hash of the retrieved text. The raw text stays private.

    OptionSourceResultWordsSHA-256
    Microsoft BookingsMicrosoft Bookings | Microsoft …retrieved164116bfee26a5
    Microsoft BookingsShared Bookings Frequently Asked …retrieved4855ffb10f8001
    Google appointment schedulesCreate an appointment schedule - …retrieved152249ac331316
    Cal.diycal.diy/README.md at main · …retrieved52936632d2e880
    Power AutomateTypes of Power Automate licenses - …retrieved4177567a139d29
    ZapierWhat is Zapier? – Zapierretrieved9853097f6c21a
    Makewww.make.comblocked: bot check001ba4719c8
    n8nn8n Docsretrieved270f8bac2777d
    n8n licenceFAQs - General FAQ - Which license …retrieved386617fe8d9a9

    A blocked source is recorded, not dropped. In a real engagement it is retried through a controlled browser session or replaced with the vendor's documentation mirror.

    StepWhat happensWhat it produces
    FrameI write the requirements and inclusion rules before searchingDecision brief
    IndexI list the titles, dates and versions of sources before reading themSource register
    CollectI use the crawler for open pages, and a controlled browser only where neededRetrieval log with timestamps
    NormaliseI rewrite each useful passage as a claim, and keep vendor claims apart from independent onesClaim matrix
    Look for negativesI re-search for rate limits, hidden costs, permission gaps and breaking changesRisk register
    CompareI score fit, data flow, admin control, cost and evidence quality; unknowns stay unknownShortlist with conditions

    What it proves

    JudgementI narrow the options by the firm's constraints, not by what is popular.
    EvidenceI log sources with dates and hashes, and record blocked sources instead of dropping them.
    RiskI check data flow and ownership before anything reaches a pilot.

    In an interview, I can walk through

    • how I gathered and prioritised the pain points;
    • the endpoint mapping between the two real systems, at the level the NDA allows;
    • why I ruled out some popular options early.