package lwt

  1. Overview
  2. Docs

Description

A promise is a value that may become determined in the future.

Lwt provides typed, composable promises. Promises that are resolved by I/O are resolved by Lwt in parallel.

Meanwhile, OCaml code, including code creating and waiting on promises, runs in a single thread by default. This reduces the need for locks or other synchronization primitives. Code can be run in parallel on an opt-in basis.

Published: 31 Dec 2020

README

Lwt   

Lwt is OCaml's concurrent programming library. It provides a single data type: the promise, which is a value that will become determined in the future. Creating a promise spawns a computation. When that computation is I/O, Lwt runs it in parallel with your OCaml code.

OCaml code, including creating and waiting on promises, is run in a single thread by default, so you don't have to worry about locking or preemption. You can detach code to be run in separate threads on an opt-in basis.

Here is a simplistic Lwt program which requests the Google front page, and fails if the request is not completed in five seconds:

let () =
  let request =
    let%lwt addresses = Lwt_unix.getaddrinfo "google.com" "80" [] in
    let google = Lwt_unix.((List.hd addresses).ai_addr) in

    Lwt_io.(with_connection google (fun (incoming, outgoing) ->
      let%lwt () = write outgoing "GET / HTTP/1.1\r\n" in
      let%lwt () = write outgoing "Connection: close\r\n\r\n" in
      let%lwt response = read incoming in
      Lwt.return (Some response)))
  in

  let timeout =
    let%lwt () = Lwt_unix.sleep 5. in
    Lwt.return None
  in

  match Lwt_main.run (Lwt.pick [request; timeout]) with
  | Some response -> print_string response
  | None -> prerr_endline "Request timed out"; exit 1

(* ocamlfind opt -package lwt.unix -package lwt_ppx -linkpkg -o request example.ml
   ./request *)

In the program, functions such as Lwt_io.write create promises. The let%lwt ... in construct is used to wait for a promise to become determined; the code after in is scheduled to run in a "callback." Lwt.pick races promises against each other, and behaves as the first one to complete. Lwt_main.run forces the whole promise-computation network to be executed. All the visible OCaml code is run in a single thread, but Lwt internally uses a combination of worker threads and non-blocking file descriptors to resolve in parallel the promises that do I/O.


Overview

Lwt compiles to native code on Linux, macOS, Windows, and other systems. It's also routinely compiled to JavaScript for the front end and Node, by js_of_ocaml and BuckleScript.

In Lwt,

  • The core library Lwt provides promises...

  • ...and a few pure-OCaml helpers, such as promise-friendly mutexes, condition variables, and mvars.

  • There is a big Unix binding, Lwt_unix that binds almost every Unix system call. A higher-level module Lwt_io provides nice I/O channels.

  • Lwt_process is for subprocess handling.

  • Lwt_preemptive spawns system threads.

  • The PPX syntax allows using all of the above without going crazy!

  • There are also some other helpers, such as Lwt_react for reactive programming. See the table of contents on the linked manual pages!


Installing

  1. Use your system package manager to install a development libev package. It is often called libev-dev or libev-devel.

  2. opam install conf-libev lwt


Documentation

We are currently working on improving the Lwt documentation (drastically; we are rewriting the manual). In the meantime:

  • The current manual can be found here.

  • Mirage has a nicely-written Lwt tutorial.

  • An example of a simple server written in Lwt.

  • Concurrent Programming with Lwt is a nice source of Lwt examples. They are translations of code from the excellent Real World OCaml, but are just as useful if you are not reading the book.

Note: much of the current manual refers to 'a Lwt.t as "lightweight threads" or just "threads." This will be fixed in the new manual. 'a Lwt.t is a promise, and has nothing to do with system or preemptive threads.


Contact

Open an issue, visit Gitter chat, ask in #ocaml, on discuss.ocaml.org, or on Stack Overflow. Please do ask! Even apparently simple questions often end up educating other users, not to mention enlightening the maintainers!

Release announcements are made in /r/ocaml, and on discuss.ocaml.org. Watching the repo for "Releases only" is also an option.


Contributing

  • We maintain easy starter issues. These are thoroughly explained and hyperlinked. We hope that this makes working on Lwt accessible even to relative OCaml beginners :)

  • CONTRIBUTING.md contains tips for working on the code, such as how to check the code out, how review works, etc. There is also a high-level outline of the code base.

  • The overall development plan can be found in the roadmap.

  • Ask us anything, whether it's about working on Lwt, or any question at all about it :)

  • The documentation always needs proofreading and fixes.

  • Despite a lot of progress, Lwt still needs more tests.

  • You are welcome to pick up any other issue, review a PR, add your opinion, etc.

  • Any feedback is welcome, including how to make contributing easier!


Libraries to use with Lwt

Dependencies (6)

  1. seq
  2. result
  3. ocaml >= "4.02.0" & < "4.12"
  4. mmap
  5. dune
  6. cppo build & >= "1.1.0"

Dev Dependencies (2)

  1. ocamlfind dev & >= "1.7.3-1"
  2. bisect_ppx dev & >= "1.3.0"

  1. 0install >= "2.14"
  2. albatross
  3. alcotest-lwt
  4. alcotest-mirage
  5. ambient-context-lwt
  6. amqp-client >= "0.9.0" & < "1.0.2" | >= "1.1.0"
  7. amqp-client-lwt >= "2.0.1"
  8. angstrom-lwt-unix
  9. anthill
  10. anycache-lwt
  11. arakoon < "1.8.6" | >= "1.8.8"
  12. archi-lwt
  13. arp >= "2.3.1"
  14. arp-mirage
  15. awa-lwt
  16. awa-mirage < "0.2.0"
  17. aws-lwt
  18. aws-s3-lwt
  19. awsm-lwt
  20. azure-cosmos-db
  21. baardskeerder
  22. balancer
  23. bap < "1.0.0"
  24. bap-server != "0.2.0"
  25. bimage-lwt
  26. biocaml = "0.4.0"
  27. bistro >= "0.4.0"
  28. brozip
  29. builder
  30. bun >= "0.3.3"
  31. c3
  32. calculon
  33. caldav
  34. camltc = "0.9.5" | >= "0.9.7.0"
  35. canary
  36. capnp-rpc-lwt < "1.2.3"
  37. capnp-rpc-unix >= "0.9.0" & < "1.2.3"
  38. caqti-lwt >= "0.11.0" & < "2.0.1"
  39. carton-git
  40. carton-lwt
  41. cf-lwt
  42. channel
  43. charrua-client >= "1.3.0"
  44. charrua-client-lwt
  45. charrua-client-mirage
  46. charrua-core < "0.3"
  47. charrua-unix >= "0.3" & != "0.10"
  48. cmdtui-lambda-term
  49. coclobas
  50. cohttp-lwt < "6.0.0~alpha2"
  51. cohttp-lwt-jsoo
  52. cohttp-lwt-unix >= "1.1.1"
  53. cohttp-lwt-unix-nossl
  54. cohttp-lwt-unix-ssl
  55. cohttp-mirage
  56. comby
  57. comby-semantic
  58. conan-lwt
  59. conduit-lwt
  60. conduit-lwt-unix
  61. core-lwt >= "0.3.0"
  62. cowabloga >= "0.2.2"
  63. crunch >= "2.0.0"
  64. cstruct-lwt
  65. csv-lwt
  66. csvprovider
  67. ctypes >= "0.15.0" & < "0.21.1"
  68. ctypes-foreign >= "0.21.1"
  69. current_docker < "0.6.4"
  70. current_examples < "0.6.4"
  71. current_git < "0.6.4"
  72. current_github < "0.6.4"
  73. current_gitlab < "0.6.4"
  74. current_ocluster < "0.2"
  75. current_slack < "0.6.4"
  76. current_web < "0.6.4"
  77. DkSDKFFIOCaml_Std
  78. dap
  79. data-encoding < "0.1.1"
  80. datakit
  81. datakit-bridge-github
  82. datakit-bridge-local-git
  83. datakit-ci
  84. datakit-client >= "0.11.0"
  85. datakit-github
  86. datakit-server
  87. devkit >= "0.6"
  88. dht < "0.2.0"
  89. distributed-lwt
  90. dkim-mirage
  91. dlm
  92. dns >= "0.19.1" & < "0.20.1"
  93. dns-certify
  94. dns-cli >= "4.6.3"
  95. dns-client < "7.0.0"
  96. dns-client-lwt
  97. dns-client-mirage
  98. dns-forward >= "0.9.0"
  99. dns-forward-lwt-unix
  100. dns-lwt
  101. dns-mirage
  102. dns-resolver
  103. dns-server
  104. dns-stub
  105. dnssd
  106. docker_hub
  107. dream
  108. dream-httpaf
  109. dream-pure
  110. dropbox
  111. dune_watch
  112. earlybird < "1.0.0"
  113. elasticsearch-cli >= "0.4"
  114. eris-lwt
  115. ethernet
  116. ez_api
  117. ezcurl-lwt
  118. ezirmin
  119. ezjsonm >= "0.4.2" & < "0.5.0"
  120. ezjsonm-lwt
  121. ezresto
  122. ezresto-directory
  123. faraday-lwt
  124. faraday-lwt-unix >= "0.6.0"
  125. fat-filesystem >= "0.12.0"
  126. fiber-lwt
  127. flowtype >= "0.72.0"
  128. frenetic < "2.0.0"
  129. fswatch_lwt
  130. fuseau-lwt
  131. gamepad
  132. gdb
  133. gdbprofiler >= "0.3"
  134. git != "1.4.3" & != "1.7.2"
  135. git-paf
  136. git-unix = "1.11.1" | >= "3.0.0" & < "3.10.0"
  137. github
  138. github-hooks < "0.2.0" | >= "0.4.0"
  139. github-unix >= "4.4.0"
  140. gitlab-unix
  141. gluten-lwt < "0.4.0"
  142. gluten-lwt-unix < "0.4.0"
  143. gluten-mirage < "0.4.0"
  144. graphql-lwt
  145. gremlin
  146. gufo
  147. h2-lwt < "0.10.0"
  148. h2-lwt-unix < "0.10.0"
  149. h2-mirage
  150. happy-eyeballs-lwt
  151. happy-eyeballs-mirage
  152. hardcaml < "1.1.0"
  153. hardcaml-examples >= "0.3.0"
  154. hardcaml-framework
  155. hiredis
  156. hl_yaml
  157. horned_worm < "0.3.1"
  158. http-lwt-client
  159. http-multipart-formdata >= "2.0.0" & < "3.0.0"
  160. http2https
  161. httpaf-lwt-unix
  162. hvsock >= "1.0.2"
  163. i3ipc >= "0.1.4"
  164. imaplet-lwt
  165. influxdb-lwt
  166. inotify >= "2.4"
  167. inquire < "0.3.0"
  168. interface-prime-lwt
  169. iocaml < "0.4.6"
  170. iocaml-kernel >= "0.4.3" & < "0.4.6"
  171. iocamljs-kernel
  172. ip2location
  173. ip2locationio
  174. ipv6-multicast-lwt
  175. irc-client-lwt
  176. irc-client-lwt-ssl
  177. irc-client-tls
  178. irmin < "0.9.6" | = "0.9.10" | >= "0.11.0" & < "2.7.0"
  179. irmin-bench < "2.7.0"
  180. irmin-chunk < "2.7.0"
  181. irmin-containers < "2.7.0"
  182. irmin-fs >= "2.3.0" & < "2.7.0"
  183. irmin-git >= "2.3.0" & < "2.7.0"
  184. irmin-graphql >= "2.3.0" & < "2.7.0"
  185. irmin-http >= "2.3.0" & < "2.7.0"
  186. irmin-indexeddb
  187. irmin-layers < "2.7.0"
  188. irmin-mem >= "2.3.0"
  189. irmin-mirage-git >= "2.3.0" & < "2.7.0"
  190. irmin-mirage-graphql >= "2.3.0" & < "2.7.0"
  191. irmin-pack < "2.7.0"
  192. irmin-test >= "2.3.0" & < "2.7.0"
  193. irmin-unix >= "2.3.0" & < "2.7.0"
  194. irmin-watcher >= "0.3.0"
  195. jerboa
  196. jitsu
  197. joolog
  198. jose < "0.9.0"
  199. js_of_ocaml < "2.5"
  200. js_of_ocaml-lwt >= "3.2.0"
  201. jsoo_broadcastchannel
  202. jsoo_router
  203. jsoo_storage
  204. jupyter >= "2.3.0"
  205. jupyter-kernel >= "0.4"
  206. kafka >= "0.3" & < "0.5"
  207. kafka_lwt
  208. kappa-library
  209. ke >= "0.5"
  210. ketrew >= "3.2.0"
  211. kinetic-client < "0.0.3" | >= "0.0.9"
  212. kubecaml
  213. lablqml < "0.6"
  214. lambda-runtime
  215. lambda-term >= "1.13"
  216. launchd
  217. learn-ocaml >= "0.13.0"
  218. learn-ocaml-client >= "0.13.0"
  219. letsencrypt
  220. letsencrypt-app
  221. letsencrypt-dns
  222. libres3
  223. links < "0.9.5"
  224. lru_cache < "v0.16.0"
  225. lwt-binio
  226. lwt-canceler
  227. lwt-dllist
  228. lwt-exit
  229. lwt-parallel >= "1.0.0"
  230. lwt-pipe
  231. lwt-pipeline
  232. lwt-watcher
  233. lwt-zmq < "1.0.0" | >= "2.0.1"
  234. lwt_camlp4
  235. lwt_domain < "0.3.0"
  236. lwt_eio < "0.4"
  237. lwt_glib >= "1.0.1"
  238. lwt_log >= "1.1.0"
  239. lwt_named_threads
  240. lwt_ppx
  241. lwt_ppx_let
  242. lwt_react >= "1.0.1"
  243. lwt_ssl >= "1.0.1"
  244. mariadb < "0.5.1"
  245. markup = "0.7.6"
  246. markup-lwt
  247. mdx
  248. mechaml
  249. metrics-influx
  250. metrics-lwt
  251. metrics-mirage
  252. metrics-unix
  253. mindstorm-lwt
  254. mirage >= "0.4.1" & != "0.6.1" & < "0.8.0" | >= "0.10.0" & < "2.7.0"
  255. mirage-block < "1.0.0" | >= "2.0.0"
  256. mirage-block-ccm
  257. mirage-block-combinators
  258. mirage-block-lwt
  259. mirage-block-ramdisk
  260. mirage-block-solo5
  261. mirage-block-unix < "2.3.0" | = "2.8.2"
  262. mirage-block-xen
  263. mirage-bootvar-solo5 >= "0.2.0"
  264. mirage-bootvar-unix
  265. mirage-bootvar-xen >= "0.4.0"
  266. mirage-channel >= "4.0.0"
  267. mirage-channel-lwt
  268. mirage-clock-freestanding < "3.0.0"
  269. mirage-clock-lwt
  270. mirage-clock-unix >= "1.2.0" & < "3.0.0"
  271. mirage-console >= "2.1.1" & < "2.2.0" | >= "3.0.0"
  272. mirage-console-lwt
  273. mirage-console-solo5 >= "0.2.0"
  274. mirage-console-unix >= "2.2.1"
  275. mirage-console-xen >= "5.0.0"
  276. mirage-console-xen-backend
  277. mirage-console-xen-cli
  278. mirage-crypto-entropy
  279. mirage-crypto-rng >= "0.7.0" & < "0.11.0"
  280. mirage-crypto-rng-lwt
  281. mirage-crypto-rng-mirage >= "0.8.8"
  282. mirage-device >= "2.0.0"
  283. mirage-dns < "3.0.0"
  284. mirage-entropy
  285. mirage-flow >= "1.0.3" & < "1.2.0" | >= "2.0.0"
  286. mirage-flow-combinators
  287. mirage-flow-lwt
  288. mirage-flow-rawlink
  289. mirage-flow-unix
  290. mirage-fs >= "3.0.0"
  291. mirage-fs-lwt
  292. mirage-fs-unix < "1.1.1" | >= "1.3.0"
  293. mirage-http
  294. mirage-http-unix
  295. mirage-http-xen
  296. mirage-kv >= "3.0.0"
  297. mirage-kv-lwt
  298. mirage-kv-unix < "3.0.0"
  299. mirage-logs
  300. mirage-nat < "3.0.0"
  301. mirage-net >= "3.0.1"
  302. mirage-net-fd
  303. mirage-net-lwt
  304. mirage-net-macosx
  305. mirage-net-solo5
  306. mirage-net-unix >= "2.2.0"
  307. mirage-net-xen
  308. mirage-os-shim >= "3.0.0"
  309. mirage-profile
  310. mirage-protocols >= "4.0.0" & < "8.0.0"
  311. mirage-protocols-lwt
  312. mirage-qubes < "0.2" | >= "0.4"
  313. mirage-qubes-ipv4
  314. mirage-random-stdlib >= "0.1.0"
  315. mirage-runtime >= "3.7.0"
  316. mirage-solo5
  317. mirage-stack >= "2.0.0" & < "4.0.0"
  318. mirage-stack-lwt
  319. mirage-time >= "2.0.0"
  320. mirage-time-lwt
  321. mirage-time-unix
  322. mirage-types-lwt < "3.7.1"
  323. mirage-unix >= "3.0.0"
  324. mirage-vnetif
  325. mirage-vnetif-stack
  326. mirage-www >= "1.1.0"
  327. mirage-xen
  328. mirror
  329. moonpool-lwt
  330. mqtt = "0.0.2"
  331. mrmime >= "0.5.0"
  332. multipart-form-data >= "0.2.0"
  333. multipart_form >= "0.2.0" & < "0.4.0"
  334. multipart_form-lwt < "0.6.0"
  335. mwt
  336. naboris < "0.1.1"
  337. named-pipe >= "0.3"
  338. nanomsg
  339. nbd = "2.1.1" | >= "3.0.0"
  340. nbd-tool
  341. nbd-unix
  342. netchannel
  343. nocrypto >= "0.5.4"
  344. noise
  345. nottui-lwt
  346. nproc
  347. nsq >= "0.4.0"
  348. obrowser
  349. obuilder < "0.4"
  350. obus >= "1.1.8" & < "1.2.1"
  351. ocaml-variants >= "4.00.1+mirage-unix" & < "4.00.1+open-types"
  352. ocluster < "0.2"
  353. ocluster-api < "0.2"
  354. ocplib-concur
  355. ocplib-resto
  356. ocsigen-start >= "4.1.0" & < "4.7.0"
  357. ocsigenserver >= "2.10"
  358. ocsipersist
  359. ocsipersist-dbm
  360. ocsipersist-lib
  361. ocsipersist-pgsql
  362. ocsipersist-sqlite
  363. odoc >= "2.0.0" & < "2.1.0"
  364. ojquery
  365. ojs-base < "0.6.0"
  366. opam-compiler < "0.2.0"
  367. opam-publish = "0.3.5"
  368. opam-sync-github-prs
  369. openflow < "0.2.0"
  370. opium >= "0.11.0" & != "0.16.0" & < "0.19.0"
  371. opium_kernel
  372. opomodoro
  373. order-i3-xfce
  374. ordma >= "0.0.3"
  375. osc-lwt
  376. oskel >= "0.3.0"
  377. ounit-lwt < "2.2.0"
  378. ounit2-lwt
  379. owork
  380. ox < "1.1.0"
  381. paf
  382. paf-cohttp
  383. pcap-format >= "0.3.3" & < "0.5.0"
  384. pgx_lwt
  385. pgx_lwt_mirage
  386. pgx_lwt_unix < "2.0"
  387. plotkicadsch >= "0.4.0"
  388. ppx_defer >= "0.4.0"
  389. ppx_deriving_rpc
  390. ppx_json_types
  391. ppx_netblob
  392. ppx_rapper_lwt
  393. ppx_sqlexpr
  394. prof_spacetime
  395. prometheus
  396. prometheus-app
  397. promise_jsoo_lwt
  398. protocol-9p >= "0.10.0"
  399. protocol-9p-unix
  400. qcow >= "0.8.1"
  401. qcow-format < "0.3"
  402. qcow-tool
  403. qfs = "0.5" | >= "0.7"
  404. quests
  405. rawlink >= "1.0" & < "2.1"
  406. rawlink-lwt
  407. redis-lwt
  408. resource-pooling >= "0.3.2"
  409. resp
  410. resp-mirage >= "0.10.0"
  411. resp-unix >= "0.10.0"
  412. resto
  413. resto-cohttp-client
  414. resto-cohttp-self-serving-client
  415. resto-cohttp-server
  416. resto-directory
  417. riak
  418. ringo-lwt
  419. river
  420. rpc >= "1.5.1" & < "7.1.0"
  421. rpclib-js
  422. rpclib-lwt
  423. sanddb
  424. scgi
  425. sendmail-lwt
  426. serial
  427. session-cohttp-lwt
  428. session-cookie-lwt
  429. session-postgresql-lwt >= "0.4.1"
  430. sessions
  431. shared-block-ring < "2.3.0" | >= "3.0.0"
  432. shared-memory-ring >= "1.2.0" & < "2.0.0"
  433. shared-memory-ring-lwt
  434. slacko
  435. socket-daemon < "0.3.0"
  436. spin < "0.6.0"
  437. spotify-web-api < "0.2.1"
  438. sqlexpr = "0.7.1" | >= "0.9.0"
  439. statsd-client
  440. stog >= "0.16.0" & < "0.19.0"
  441. syndic >= "1.4" & < "1.6.0"
  442. tar-format >= "0.4.1"
  443. tar-mirage < "2.2.0"
  444. tar-unix
  445. tcpip >= "3.1.1"
  446. teash
  447. telegraml
  448. tezos-p2p < "8.0" | >= "11.0" & < "13.0"
  449. tezos-stdlib < "9.3"
  450. tezos-stdlib-unix < "9.0"
  451. tftp
  452. themoviedb
  453. tls >= "0.10.1" & < "0.16.0"
  454. tls-lwt < "0.17.4"
  455. tls-mirage
  456. tlstunnel >= "0.2.0"
  457. transmission-rpc
  458. tube >= "4.3.0"
  459. tuntap >= "1.0.0" & < "2.0.0"
  460. typerex-lldb
  461. u2f
  462. uspf
  463. uspf-lwt
  464. utop >= "1.4.0"
  465. uwt >= "0.3.0"
  466. vchan >= "0.9.7" & < "2.0.0" | >= "2.0.3"
  467. vchan-unix
  468. vchan-xen
  469. vercel
  470. vhd-format >= "0.7.0" & < "0.8.0"
  471. vhd-format-lwt >= "0.12.0"
  472. vhd-tool < "0.12.0"
  473. vmnet >= "1.3.2"
  474. vpnkit >= "0.2.0"
  475. vue-jsoo < "0.3"
  476. webauthn
  477. websocket < "2.3"
  478. xe-unikernel-upload
  479. xen-api-client < "0.9.14"
  480. xen-block-driver
  481. xen-evtchn != "1.0.6"
  482. xen-evtchn-unix
  483. xen-gnt >= "2.2.3"
  484. xenctrl < "0.9.29" | >= "0.9.32"
  485. xenstore >= "1.3.0"
  486. xenstore_transport >= "1.0.0"
  487. xentropyd
  488. yurt < "0.3"
  489. zbar
  490. zmq-lwt

Conflicts (1)

  1. ocaml-variants = "4.02.1+BER"