gitoriaLog in with ident

gitoria

All repositories: gitoria

ReadmeCodePull requestsReleasesTicketsSettings
Branchmain4f47843egate: ticket links use the tickets short URL (/<slug>/<n>, tickets#25)mremain/plugins/fetch/server.hl

5.6 KB

  1. // hl:fetch — the HTTP(S) client, function-module realm (mission 135).
  2. // SERVER realm only: the browser has its own fetch, and hl:web's client bundle
  3. // must keep using it rather than tunnelling requests through the server.
  4. //
  5. // import { fetch } from 'hl:fetch'
  6. //
  7. // res = fetch("https://api.example.com/users")
  8. // res.status // 200
  9. // res.ok // true
  10. // res.headers["content-type"] // lowercased header names
  11. // res.text() // the body as a String
  12. // res.json() // the body parsed
  13. //
  14. // fetch(url, {
  15. // method = "POST",
  16. // headers = { authorization = "Bearer …" },
  17. // json = { name = "Ada" }, // stringified, content-type set for you
  18. // body = "raw bytes instead", // when you want to send it yourself
  19. // timeoutMs = 5000, // the WHOLE exchange; default 30000
  20. // maxRedirects = 5, // 0 returns the 3xx instead of following
  21. // caFile = "/path/ca.pem", // an EXTRA trust anchor (see below)
  22. // tag = "users" // echoed back, for completion events
  23. // })
  24. //
  25. // TLS: certificate verification is ALWAYS ON — the system trust store plus a
  26. // hostname check against the certificate. There is no verify-off switch, by
  27. // design. To reach a server whose certificate the system does not know (a test
  28. // fixture's self-signed pair, an internal CA), NAME it with `caFile`; that adds
  29. // one anchor and leaves every other connection verified as before.
  30. //
  31. // PARALLELISM. `fetch()` starts the request and waits for the answer. To have
  32. // several in flight at once, start them with `fetchStart()` — which never waits —
  33. // and read them afterwards:
  34. //
  35. // pending = concurrent [ fetchStart(a), fetchStart(b), fetchStart(c) ]
  36. // for (p of pending) { console.log(p.response().status) }
  37. //
  38. // (A `concurrent` arm runs to completion before its sibling starts, so an arm
  39. // that waited on a socket would serialize the group. An arm that only starts a
  40. // thread does not — which is why the wait is a separate call.)
  41. //
  42. // EVENTS. `completions()` is an ordinary event-loop source: register it and a
  43. // finished fetch arrives as an event, so a server never waits for one at all.
  44. //
  45. // __native("eventloop.register", completions(), "fetched")
  46. // on fetched(ev) { … } // { tag, url, status, ok, body, error, headers }
  47. //
  48. // STREAMING (the LLM-token mode). `stream = true` delivers the body INCREMENTALLY
  49. // as chunk frames on the completions source instead of accumulating it — an SSE
  50. // or NDJSON stream (OpenRouter, ollama, any OpenAI-style endpoint) arrives token
  51. // by token; chunked transfer is decoded, anything else streams as read:
  52. //
  53. // __native("eventloop.register", completions(), "tok")
  54. // p = fetchStart(url, { method = "POST", json = {…}, stream = true, tag = "llm" })
  55. // on tok(ev) {
  56. // if (ev.chunk != null) { …ev.chunk arrived… return null }
  57. // …ev is the final { tag, status, ok, headers, error, aborted } — body is
  58. // EMPTY, the chunks were the body…
  59. //
  60. // THE INTERRUPT: `fetchAbort("llm")` stops an in-flight stream mid-generation —
  61. // the socket closes (the wire-level stop every LLM server understands), the
  62. // final frame arrives with `aborted = true`.
  63. // }
  64. //
  65. // A redirect is followed BEFORE streaming starts; only the final answer streams.
  66. // `result()` still works: it waits for the stream's end and yields the summary.
  67. //
  68. // HTTP/1.1 only. An h2 client is a later slice (it needs client-side ALPN and a
  69. // multiplexed connection pool); every request here sends `connection: close`.
  70. // Start a request and wait for the answer. Equivalent to `fetchStart(…).response()`.
  71. //
  72. // EXCEPT in STREAM MODE, where waiting is the one thing a caller cannot want: the
  73. // answer only ends when the stream does, so `stream = true` hands back the
  74. // PendingFetch AT ONCE with its own event source already armed. That is what
  75. // makes `on p.chunk` / `on p.done` work on nothing but the object — no global
  76. // listener, no `completions()` registration, exactly as the module header and
  77. // tests/native/plugins/049_fetch_stream.hl describe.
  78. //
  79. // (RESTORED 2026-08-29, mission 257: this branch was missing, so a streaming
  80. // `fetch()` blocked until the stream ended and then returned a FetchResponse
  81. // that no `on p.chunk` could ever fire on. Nothing caught it — every fetch test
  82. // in the tree needed a fixture server that had gone missing too.)
  83. fetch(url, options) {
  84. let p = fetchStart(url, options)
  85. if (options != null && options.stream == true) {
  86. p.arm()
  87. return p
  88. }
  89. return p.response()
  90. }
  91. // Start a request and return at once. The answer is read with `.response()`.
  92. fetchStart(url, options) {
  93. let o = options
  94. if (o == null) {
  95. o = {}
  96. }
  97. // `json = {…}` is the ergonomic half of "JSON both ways": serialize here,
  98. // where JSON already lives, and let the native side add the content-type
  99. // only when the caller did not set one.
  100. if (o.json != null) {
  101. o.body = JSON.stringify(o.json)
  102. o.jsonBody = true
  103. }
  104. return {
  105. #handle = __native("fetch.start", url, o);
  106. } > new PendingFetch()
  107. }
  108. // The event-loop source of finished fetches. Calling it arms completion delivery
  109. // for every fetch started from then on.
  110. completions() {
  111. return __native("fetch.completions")
  112. }
  113. // THE INTERRUPT (the LLM stop button): abort every in-flight fetch started with
  114. // this `tag` — the socket is shut down, the peer sees the disconnect (an LLM
  115. // server stops generating and billing), and the FINAL completion frame arrives
  116. // with `aborted = true` and error "hl:fetch: aborted". Returns how many were
  117. // aborted; 0 means nothing was in flight under that tag.
  118. fetchAbort(String tag) {
  119. return __native("fetch.abort", tag)
  120. }

Branches

  • mainmain branch

Latest commits

  • 4f47843egate: ticket links use the tickets short URL (/<slug>/<n>, tickets#25)mre
  • 86605446mission 002 (code order) 4/4: README file map + import order + 'Same output' test + gate run with a tickets HEAD copy, STATUS (entry, lessons), LOG, report; tests/realdata-baseline.mjs + realdata-compare.py (a cleanup answers the same on live data: pages, modules, API, git over HTTPS and SSH, faces), tests/letcount.pymre
  • cc7bf7bamission 002 (code order) 3/4: let only where a variable is reassigned or re-bound in a loop body (289 lets → plain declarations; 213 left: 125 reassigned, 88 loop-bound; no member/import/param clash). gates 200/0, 46/0, 44/0; real-data reads + writes identical (browser modules: var → const only)mre
  • 090a20c6mission 002 (code order) 2/4: one lib/ file per topic — git.hl split into git (calls, branches, init, temp folder) / homepage / code / pulls / releases (+ git-helpers: paths, ids, |||PR/|||RL markers); repos-helpers, tickets-helpers, transport-helpers; util.hl = localtime + env, storage dir, addresses, lists, text checks, one newest-first sort (was 3 copies); the function routes out of project.hl into lib/api.hl (thin; plumbing in api-helpers.hl), sshgate.hl folded into api.hl + sshkeys.hl keyLine + repos.hl mayPush; 'Make main' and the merge answer out of the faces (code.hl makeMain, pulls.hl pullsView), one login helper (users.hl userOfLoginCode); project.hl is the map. Session-writing routes get &req + &server.sessions. gates 200/0, 46/0, 44/0; real-data identical except /login/failed now shows the parked reason for a browser that already had a session (the old copy-of-req lost it)mre
  • 110c2799mission 002 (code order) 1/4: .hl files out of the root — lib/ (api, git, localtime, markdown, repos, sshgate, sshkeys, tickets, tokens, transport, users), components/styles.hl; jsoncheck.hl removed (imported nowhere); import paths only. gates 200/0, 46/0, 44/0; real-data reads + writes identicalmre
  • fdfb4b1bgitoria: Hybriel master 06617221 (plugin allocators 3a781359 + 413f60e4, mpackdb 2cb7ae5e, http1 773de63e); gates 200/0, 46/0, 44/0mre
  • 5b46ac84antcolony#40: LOG.md — missions 069/072 are antcolony missions (report paths on Byrodin)mre
  • 5602ff41gitoria: Hybriel master 190aa11d (fc838894 GC correctness, #127 mountKids by reference, #126, #48) — tracker README flat; gates 200/0, 46/0, 44/0mre
  • e85eaf01gitoria: 069 round 2 — hybriel 1a096ad3 not adopted (Markdown SSR still grows); browser gate waits for the server-side logout before restartmre
  • 09ce4f3fgitoria: mission 069 re-vendor hybriel 8efba065 stopped (big SSR pages grow + slow down); lambda audit clean; old vendor keptmre
  • 3dc43108antcolony#40: mission references point to the moved missionsmre
  • 8d9450fdantcolony#40: history (LOG.md), worker briefs (missions/) and reports moved here from antcolony, numbered per project; old numbers in antcolony docs/mission-map.mdmre
  • 205d5fe4gitoria: Hybriel master ff51cf46; ssh keys/tokens no double rows (session sync); gates follow #20mre
  • 9b27cb26gitoria#21: installable app (manifest, service worker, offline start page), own iconmre
  • 68dcb603deploy.sh: back up live storage/.sessions/.env before every deploy (newest 5 kept)mre
  • e2deed6dgitoria#20: "Add code" only on the Code page of an empty repository, no collapsiblemre
  • 8bb97ffddeploy.sh: never send .git or .gitignore to Byrodinmre
  • fd981932State of 2026-09-27; bin/ no longer tracked (Hybriel commit is in README)mre
  • 4a2d7125initial commitmre