Isaac E. Maple

Isaac Maple, smiling, in glasses, a dark cap and a black polo shirt, against a dark background.
  • AI Engineer, On-Device LLM Inference
  • Founder, TokForge
  • DMZ Network Architect, Bank of America
  • Dallas, Texas
Download the two-page PDF

The two-page resume is the short version. This page is the full record. PDF, 2 pages, 90 KB

Summary

AI engineer who builds on-device AI and the GPU infrastructure that serves large models. Founder of TokForge, an Android and iOS app with 10,000+ installs in 169 countries that runs language, vision, voice and image models entirely on the phone. I built its Kotlin/C++ runtime around llama.cpp and a maintained fork of MNN, with per-chip GPU and NPU acceleration. I also built a ten-GPU, two-server AI server that runs open models up to 1 trillion parameters, and the high-availability hosting platform behind 20+ websites. DMZ network architect at Bank of America, with 15 years in production networking and security.

Skills

LLM inference
llama.cpp, MNN, ggml, vLLM, SGLang, ExLlamaV3, MLX, Core ML, TFLite; GGUF, AWQ, FP8 and NVFP4 quantization; 4-bit KV cache; speculative decoding (EAGLE, MTP, draft models); multi-GPU tensor and pipeline parallelism over RDMA
ML and evaluation
PyTorch, Hugging Face Transformers, PEFT/LoRA, FSDP, DDP; RAG (BM25 plus vector search, reciprocal rank fusion, cross-encoder rerank, pgvector, sqlite-vec); LLM-as-judge evaluation on sealed test sets
Mobile and systems
Android (Kotlin, Jetpack Compose, NDK/JNI, C++), iOS (Swift, SwiftUI), GPU inference (Vulkan, OpenCL), Qualcomm QNN and Hexagon NPU, Python, FastAPI, TypeScript, SQL, Bash
Infrastructure and security
DMZ and perimeter architecture, Zero Trust segmentation, Linux, VMware ESXi, Cloudflare (WAF, load balancing, Workers, Tunnels, Access), MySQL Group Replication, PostgreSQL, Ansible, Prometheus, Grafana, WireGuard, VyOS, Arista, Cisco, Juniper, F5, ModSecurity and OWASP CRS

Experience

DMZ Network Architect, Bank of America

Jun 2023 to PresentPlano, Texas (remote)

I design and review DMZ and perimeter network architecture for internet-facing workloads, partner connectivity and secure access to banking systems.

  • Develop reference architectures and design patterns for segmentation and Zero Trust access, and contribute to technical design reviews.
  • Serve as the AI lead for the DMZ team, working with the Automation and Alignment teams.
  • Contribute to infrastructure and security upgrades for CashPro and for the bank’s Federal Reserve connectivity.
  • Support ATM and alarm-panel infrastructure upgrades for asset tracking.

Founder and Developer, TokForge.ai

Feb 2026 to PresentRemote

TokForge is an all-in-one on-device AI app for Android and iPhone: chat, photo, audio and video understanding, document search, image generation, speech in and out, voice cloning, tool-calling agents and web search, all running on the phone with no account and no cloud processing by default. Built on llama.cpp and a fork of Alibaba’s MNN runtime that I maintain. Solo founder; published by Defcon-One. Also building SurvivalOps.io and Folio, an AI game master for long-form interactive fiction.

  • Launched on Google Play (10,000+ installs in 169 countries, 3,000+ active users) and Apple TestFlight, with 19 public releases since the 1.0 launch in August 2026.
  • Built a per-chip routing layer in the Kotlin/C++ runtime that sends each model to the fastest backend proven stable on that chip (CPU, Vulkan or OpenCL GPU, or the Qualcomm Hexagon NPU), with the slowest proven path as the fallback on unknown hardware.
  • Shipped LLM chat on the phone’s NPU: on Snapdragon phones the Hexagon NPU reads long prompts about 4x faster than the CPU.
  • Built GPU inference on Vulkan and OpenCL for Qualcomm Adreno, Arm Mali and Samsung Xclipse, with per-chip rules that work around vendor driver bugs, plus speculative decoding and a 4-bit KV cache that cuts long-chat memory 3.5x.
  • Brought desktop-class AI to phones: a 35-billion-parameter model runs at 9 to 12 tokens per second on a 24 GB Android phone, and a 30-billion-parameter model runs at 14.4 tokens per second on an iPhone 17 Pro Max.
  • Shipped one on-device model that understands photos, audio and video, Stable Diffusion 1.5 on the Hexagon NPU through Qualcomm QNN without root (512x512 in 6 to 10 s), and on-device document chat (RAG) with INT8 embeddings and hybrid keyword plus vector search.
  • Shipped four production releases in 16 days (October 22 to November 6, 2026) with crash and ANR rates inside Google Play’s thresholds, in 9 languages.
  • Built SurvivalOps on the same engine: an offline survival and medical assistant with a 1,400+ book library, offline Wikipedia and topo maps, and photo questions answered on the phone by a 4B vision model.
  • Published 106 model-conversion and deployment repositories on Hugging Face (MNN and GGUF conversions, QNN NPU binaries), with 180,000+ downloads.

More detail

  • Vulkan GPU work: found and worked around graphics-driver bugs on Adreno, Mali and Xclipse GPUs using per-operation backend tests, then encoded per-chip rules so the app never ships a known-bad path.
  • Desktop-class models on phones: a 35-billion-parameter model at 9 to 12 tokens per second on a 24 GB Android phone and a 30-billion-parameter model at 14.4 tokens per second on an iPhone 17 Pro Max. KV cache reuse makes follow-up replies start almost instantly, and a 4-bit KV cache cuts long-chat memory 3.5x.
  • NPU and multi-token prediction: Qwen3.5 4B and 9B run with the Hexagon NPU reading the prompt, and multi-token prediction switches on only where the phone measures a gain.
  • On-device RAG: INT8 BGE-small embeddings on TFLite/XNNPACK, hybrid keyword plus vector search with MMR, and knowledge-graph extraction.
  • Hardware coverage: every release is tested on 12 Android phones (Qualcomm, MediaTek, Samsung Exynos, Google Tensor) and 4 Apple devices before it ships.
  • Production monitoring: crash and ANR tracking through the Google Play Developer Reporting and App Store Connect APIs.

Co-Founder and Technical Lead, Elevated-Marketing.io

Nov 2024 to PresentRemote

I built and run the hosting platform behind 20+ websites, our clients’ and our own, for the digital marketing agency I co-founded: a database cluster with five voting members across four sites, AI-driven monitoring and layered security. The agency offers web design, SEO, social media and hosting. My partner runs sales and client work; I run hosting, infrastructure, security and AI tooling, part-time.

  • Rebuilt high availability as a MySQL Group Replication cluster with five voting members across four sites. A write commits only when a majority agrees, and Cloudflare load balancing follows the primary, so any one site can fail without stopping writes.
  • Rode through a real 55-minute data center outage on October 29, 2026: the cluster elected a new primary in about a minute, with no visitor-facing outage on load-balanced sites.
  • Proved it in a planned drill that moved 20 domains to another site, with writes tested, in 101 seconds.
  • Built GuardAI, our AI monitoring system: it reads every server error (pattern match, then a small language model, then a local vLLM model), explains it on a Grafana NOC dashboard, and fixes common issues on its own within rate limits, with backup and rollback.
  • Moved the whole fleet to a new data center with zero downtime (two-step Cloudflare edge flip, MySQL GTID replication).
  • Hardened the fleet with per-site PHP isolation, Cloudflare-only origin access, ModSecurity with the OWASP Core Rule Set, fail2ban and Cloudflare WAF, with automatic bans against 1,600+ logged attacks.
  • Keep immutable backups (Veeam to S3 storage with Object Lock) in three locations.
  • Led the build of Elevated POS, an event-sourced restaurant point-of-sale and ordering platform with smart card terminals, a kitchen display and an offline-first design that never loses a sale.
  • Ran SEO and paid search for the client fleet through the Google Search Console and Google Ads APIs, including audits across 13 client properties; one contractor client’s site leads grew 79% (42 to 75 a month).

More detail

  • Cluster: MySQL Group Replication in single-primary mode with five voting members across four sites, Syncthing file sync, and a manifest-driven web stack deployed with Ansible.
  • Failover: Cloudflare health checks pass only on the current primary, and a DNS-steering Cloudflare Worker moves the plain-DNS sites with it.
  • Disaster recovery: immutable backups on self-hosted object storage (about 255 TB across five storage servers) in three locations.
  • Network: a WireGuard full mesh across five sites on VyOS routers, with Tailscale for remote access.
  • Monitoring: VictoriaMetrics, Prometheus, Loki and Grafana with paging over WhatsApp.
  • Security: Cloudflare-only origin access, per-site PHP isolation, ModSecurity with the OWASP Core Rule Set, fail2ban keyed to its anomaly score, a live threat map, and a security-posture review across all client domains.
  • Growth: SEO and paid search across the client fleet, with audits across 13 Search Console properties, recovered search traffic on rebuilt sites, and Google Ads with offline conversion upload.

Owner, Defcon-One

Jul 2009 to PresentDallas, Texas (remote)

Defcon-One is my independent cybersecurity, AI and managed IT brand, and the publisher of TokForge.

  • Publisher of TokForge, my on-device AI app for Android and iPhone.
  • Services: cybersecurity, managed IT, server and data center infrastructure, and AI integration.

Earlier experience

  1. May 2022 to Jun 2023

    Senior Network Project Engineer, centrexIT

    Ran network, server and security projects for clients across the US, from infrastructure upgrades, security hardening and virtualization to SD-WAN and VPN rollouts for multi-site chains. Handled escalations and trained junior engineers.

  2. Mar 2021 to May 2022

    Director of Network Operations (promoted from NOC Manager), NGA 911

    Ran the help desk, NOC, SOC and field operations teams for a cloud-based Next Generation 911 provider. Built the operating procedures for a new 24/7 network operations center.

  3. Jul 2018 to Mar 2021

    Network Engineer III, Spectrum Enterprise

    Fixed network and voice outages for business customers on a large VoIP platform (PRI and SIP trunking) and provided after-hours support.

  4. Jul 2016 to Jul 2018

    Network Engineer III, Frontier Communications

    Managed a network operations center covering 28 states. Helped connect more than 900,000 homes under a federal rural internet program, and cut cutover prep time 42% by automating provisioning and backups.

  5. Apr 2015 to Jun 2016

    NOC Engineer I, Baylor Scott & White Health

    Night and weekend network operations for a health system of 15+ hospitals and 100+ clinics: changes to routers, switches and access points, on-site hardware replacement, and bringing 5 hospitals and 100 clinics onto the Baylor network.

  6. Sep 2014 to Apr 2015

    Telephony NOC Engineer I, Suddenlink Communications

    Resolved SIP and PRI issues for business voice customers, trained new NOC telephony staff, and served as lead technician on a project that moved $1.2M of carrier voice lines onto Suddenlink’s network.

  7. 2008 to 2014

    Network operations and support, Earlier roles

    Time Warner Cable (2,500+ cell-tower connections), General Dynamics, Windstream and CenturyLink.

Education

  • University of Texas at TylerAttended, 2008 to 2011
  • Tyler Junior CollegeAssociate of Science, Computer Science

Certifications

  • CompTIA A+
  • Cisco CCENT
  • SSCA (SIP)

Other: Eagle Scout