# HG changeset patch # User Richard Westhaver # Date 1714529789 14400 # Node ID 6e1e5ecd7bd3357a086e04e3f7745d1f20eb80a3 # Parent c099290dcde97c5e26160aadb4ff234a381ba6a2 bump diff -r c099290dcde9 -r 6e1e5ecd7bd3 .hgsub --- a/.hgsub Wed Jan 10 19:02:43 2024 -0500 +++ b/.hgsub Tue Apr 30 22:16:29 2024 -0400 @@ -1,2 +1,4 @@ blog=https://vc.compiler.company/comp/blog -docs=https://vc.compiler.company/comp/docs \ No newline at end of file +docs=https://vc.compiler.company/comp/docs +notes=notes +roadmap=roadmap \ No newline at end of file diff -r c099290dcde9 -r 6e1e5ecd7bd3 .hgsubstate --- a/.hgsubstate Wed Jan 10 19:02:43 2024 -0500 +++ b/.hgsubstate Tue Apr 30 22:16:29 2024 -0400 @@ -1,2 +1,4 @@ -b6380832df99ead6c390a664bdf3b5623444a978 blog -2601788ab8056c66fed0fb2c63acbda1fb617576 docs +d77884ec2b44578aed4268cd374d559cd7643470 blog +6932edcf60ecc20bc51f89e8131a962a8aa58b7c docs +87b04952fb18f2eb67d3ca17ae1c745c6aa91c44 notes +70c3464617973e82b02ff481bf300f2bdbe9de01 roadmap diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20230730.org --- a/notes/20230730.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,36 +0,0 @@ -* VC infrastructure -In heptapod we have a root group named =comp=, containg a variety of -subgroups. Some of these groups should be public, while others are -internal to comp members exclusively. Within each subgroup, we should -have the root group members automatically granted privileged access to -projects. This is relevant for the =startup= subgroup in particular, -where each project is potentially maintained by multiple non-root -contributors. - -We also need to consider how we will manage subrepos across the -organization. It is about time we start integrating HG bundles and -potentially mirrors. For our core VC pipeline we should have no -reliance on Git, but this may be difficult. It depends on the behavior -of HG bundles. - -Bookmarks/tags should be used for milestones in the root group and are -infrequent. They are more frequent in projects with a regular release -life-cycle. -* Approaching Webapps -I started poking around in the webapp space again so that I can launch -a landing page for NAS-T quickly. The Rust situation has improved -somewhat on the frontend side, and the axum backend stack is nice. - -This might seem like a lot of Rust and not a lot of Lisp, which it is, -but there's still room for Lisp wherever we need it. It mostly plays a -role in the backend, servicing the database and responding to requests -from the Rust edges. All of the important tests for the web APIs are -also written in Lisp. We will almost certainly use Lisp for all static -processing and HTML generation at compile-time. - -This I believe, is the appropriate way to integrate Lisp into a -cutting-edge web-app. You get the good parts of Lisp where you need -them (interactive debugging, dynamic language, REPL) and avoid the bad -parts (OOB optimization, RPS performance) in areas where the customer -would be impacted. In this domain, Lisp takes the form of a glue -rather than the bricks and mortar it sometimes appears to us as. diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20231024.org --- a/notes/20231024.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,59 +0,0 @@ -* virt -** QEMU -** KVM -** Hyper-V -** Firecracker -** Docker -** Vagrant -** LXC -** LXD -** containerd -** systemd-nspawn -** VirtualBox - -* Concatenative -** Factor :factor: -- [2023-07-04 Tue] - Factor is a cool concatenative lang but unfortunately the C interface - (vm/master.h) no longer exists on the master branch. -** Joy :joy: - -*** https://hypercubed.github.io/joy/html/j02maf.html - -*** [[https://builds.openlogicproject.org/content/incompleteness/arithmetization-syntax/arithmetization-syntax.pdf][arithmetization of syntax]] -* Lisp :lisp: -These notes pertain to Lisp. More specifically, ANSI Common Lisp in -most places. - -- https://github.com/lispnik/iup/ - doesn't support MacOS yet, looks - cool though - - what we really need is wasm compiler.. TBD -* Rust -** Serde -- [2023-07-05 Wed] \\ - important part of the Rust ecosystem, another dtolnay - contribution. If you want to program a /data/ format in the Rust - ecosystem, this is how you do it. - - The way it works is that you define some special structs, a - Serializer and a Deserializer which implement the Serialize and - Deserialize traits provided by serde, respectively. - - You can use these structs to provide your public API. The - conventional choice is public top-level functions like from-str - and to-string. That's it, your serialization library can now read and - write your data format as Rust data types. - - [[https://serde.rs/enum-representations.html][enum-representations]] - - the default behavior is an externally tagged representation (verbose) - - The docs use strings as core IO when implementing a custom format, - but the convention is to implement for T where T is bound by std::io - Read or Write trait. Then you can provide a more robust public API - (from_bytes, from_writer, etc). -* C -* CPP -* Nu -[[https://www.nushell.sh/][~]] -[[https://www.nushell.sh/cookbook/][cookbook]] -[[https://github.com/nushell/nu_scripts][nu_scripts]] diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20231101.org --- a/notes/20231101.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,18 +0,0 @@ -* AWS usage -We're leveraging AWS for some of our public web servers for now. It's -really not realistic to expect that my home desktop and spotty Comcast -internet can serve any production workflow. What it /is/ capable of is -a private VPN, which can communicate with AWS and other cloud VPN -depots via WireGuard ([[https://dev.to/gabrieltetzner/setting-up-a-vpn-with-wireguard-server-on-aws-ec2-4a49][article]]). - -I currently use Google Domains for nas-t.net, otom8.dev, and -rwest.io - but that business is now owned by squarespace, so I would -rather move it to Route53. - -We have archlinux ec2 image builds [[https://wiki.archlinux.org/title/Arch_Linux_AMIs_for_Amazon_Web_Services][here]] and [[https://gitlab.com/anemos-io/archlinux-ec2][here]] - only half work and not -maintained, but it's a start. I'm not even sure if I should stick with -arch or cave and use Ubuntu or AWS Linux. We can serve the static -services with little cost, the only big spender will be the heptapod -instance which requires a larger instance and some workers. - -We'll try to keep the cost at or around $30/month. diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20231102.org --- a/notes/20231102.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,82 +0,0 @@ -* IDEAS -** TODO shed -:PROPERTIES: -:ID: fc9a94e1-91c5-4915-90b8-73218fa3b8bc -:END: -:LOGBOOK: -- State "TODO" from [2023-04-07 Fri 23:24] -:END: -rlib -> ulib -> ulib -> ulib -> ulib - -*** TODO sh* tools -:PROPERTIES: -:ID: c0613a13-7ccb-4af9-b47e-e14a41c782c2 -:END: -:LOGBOOK: -- State "TODO" from "TODO" [2023-04-07 Fri 23:22] -:END: -shc,shx,etc -** WIP packy -:LOGBOOK: -- State "TODO" from [2023-04-07 Fri 23:33] -:END: -*** WIP rust -*** WIP common-lisp -*** WIP emacs-lisp -*** python -*** julia -*** C -*** C++ -** TODO tenex -:LOGBOOK: -- State "TODO" from [2023-04-07 Fri 23:52] -:END: -** TODO mpk -:LOGBOOK: -- State "TODO" from [2023-04-07 Fri 23:52] -:END: -** TODO cfg -:LOGBOOK: -- State "TODO" from [2023-04-07 Fri 23:34] -:END: -** TODO obj -:LOGBOOK: -- State "TODO" from [2023-04-07 Fri 23:51] -:END: -split out from rlib to separate package -- a purely OOP class library -** TODO lab -:LOGBOOK: -- State "TODO" from [2023-04-07 Fri 23:34] -:END: -** TODO source categories -- need a way of extracting metadata from a repo -- need ability to search and query libs/packages -- separate modules based on where they belong in our stack? - - app - - lib - - script? - - dist - - software distros -** TODO generic query language -from obj protocol? -sql compatibility? - -/check out kdb/ -** TODO bbdb -:LOGBOOK: -- Note taken on [2023-10-24 Tue 22:16] \\ - graph database, build on rocksdb -:END: -insidious Big Brother database. -- an application built with obj -- sql - -** TODO NAS-TV :nas:t: -- media streaming -- gstreamer backend -- audio/video diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20231105.org --- a/notes/20231105.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,136 +0,0 @@ -* DRAFT dylib-skel-1 -- State "DRAFT" from [2023-11-05 Sun 22:23] -** Overview -Our core languages are [[https://www.rust-lang.org/][Rust]] and [[https://lisp-lang.org/][Lisp]] - this is the killer combo which will allow NAS-T -to rapidly develop high-quality software. As such, it's crucial that these two very -different languages (i.e. compilers) are able to interoperate seamlessly. - -Some interop methods are easy to accomodate via the OS - such as IPC or data sharing, -but others are a bit more difficult. - -In this 2-part series we'll build a FFI bridge between Rust and Lisp, which is something -that /can/ be difficult, due to some complications with Rust and because this is not the -most popular software stack (yet ;). This is an experiment and may not make it to our -code-base, but it's definitely something worth adding to the toolbox in case we need it. - -** FFI -The level of interop we're after in this case is [[https://en.wikipedia.org/wiki/Foreign_function_interface][FFI]]. - -Basically, calling Rust code from Lisp and vice-versa. There's an article about calling -Rust from Common Lisp [[https://dev.to/veer66/calling-rust-from-common-lisp-45c5][here]] which shows the basics and serves as a great starting point -for those interested. -*** Rust != C -The complication(s) with Rust I mentioned early is really just that /it is not C/. =C= -is old, i.e. well-supported with a stable ABI, making the process of creating bindings -for a C library a breeze in many languages. - -For a Rust library we need to first appease the compiler, as explained in [[https://doc.rust-lang.org/nomicon/ffi.html#calling-rust-code-from-c][this section]] -of the Rustonomicon. Among other things it involves changing the calling-convention of -functions with a type signature and editing the Cargo.toml file to produce a -C-compatible ABI binary. The Rust default ABI is unstable and can't reliably be used -like the C ABI can. - -*** Overhead -Using FFI involves some overhead. Check [[https://github.com/dyu/ffi-overhead][here]] for an example benchmark across a few -languages. While building the NAS-T core, I'm very much aware of this, and will need a -few sanity benchmarks to make sure the cost doesn't outweigh the benefit. In particular, -I'm concerned about crossing multiple language barriers (Rust<->C<->Lisp). - -** Rust -> C -> Lisp -*** Setup -For starters, I'm going to assume we all have Rust (via =rustup=) and Lisp (=sbcl= only) -installed on our GNU/Linux system (some tweaks needed for Darwin/Windows, not covered in -this post). -**** Cargo -Create a new library crate. For this example we're focusing on a 'skeleton' for -/dynamic/ libraries only, so our experiment will be called =dylib-skel= or *dysk* for -short. -src_sh[:exports code]{cargo init dysk --lib && cd dysk} - -A =src/lib.rs= will be generated for you. Go ahead and delete that. We're going to be -making our own =lib.rs= file directly in the root directory (just to be cool). - -The next step is to edit your =Cargo.toml= file. Add these lines after the =[package]= -section and before =[dependencies]=: -#+begin_src conf-toml -[lib] -crate-type = ["cdylib","rlib"] -path = "lib.rs" -[[bin]] -name="dysk-test" -path="test.rs" -#+end_src - -This tells Rust to generate a shared C-compatible object with a =.so= extension which we -can open using [[https://man.archlinux.org/man/dlopen.3.en][dlopen]]. -**** cbindgen -***** install -Next, we want the =cbindgen= program which we'll use to generate header files for -C/C++. This step isn't necessary at all, we just want it for further experimentation. - -src_sh[:exports code]{cargo install --force cbindgen} - -We append the =cbindgen= crate as a /build dependency/ to our =Cargo.toml= like so: -#+begin_src conf-toml -[build-dependencies] -cbindgen = "0.24" -#+end_src -***** cbindgen.toml -#+begin_src conf-toml :tangle cbindgen.toml -language = "C" -autogen_warning = "/* Warning, this file is autogenerated by cbindgen. Don't modify this manually. */" -include_version = true -namespace = "dysk" -cpp_compat = true -after_includes = "#define DYSK_VERSION \"0.1.0\"" -line_length = 88 -tab_width = 2 -documentation = true -documentation_style = "c99" -usize_is_size_t = true -[cython] -header = '"dysk.h"' -#+end_src -***** build.rs -#+begin_src rust :tangle build.rs -fn main() -> Result<(), cbindgen::Error> { - if let Ok(b) = cbindgen::generate(std::env::var("CARGO_MANIFEST_DIR").unwrap()) { - b.write_to_file("dysk.h"); Ok(())} - else { panic!("failed to generate dysk.h from cbindgen.toml") } } -#+end_src -*** lib.rs -#+begin_src rust :tangle lib.rs -//! lib.rs --- dysk library -use std::ffi::{c_char, c_int, CString}; -#[no_mangle] -pub extern "C" fn dysk_hello() -> *const c_char { - CString::new("hello from rust").unwrap().into_raw()} -#[no_mangle] -pub extern "C" fn dysk_plus(a:c_int,b:c_int) -> c_int {a+b} -#[no_mangle] -pub extern "C" fn dysk_plus1(n:c_int) -> c_int {n+1} -#+end_src -*** test.rs -#+begin_src rust :tangle test.rs -//! test.rs --- dysk test -fn main() { let mut i = 0u32; while i < 500000000 {i+=1; dysk::dysk_plus1(2 as core::ffi::c_int);}} -#+end_src -*** compile -#+begin_src sh -cargo build --release -#+end_src -*** load from SBCL -#+begin_src lisp :tangle dysk.lisp -(load-shared-object #P"target/release/libdysk.so") -(define-alien-routine dysk-hello c-string) -(define-alien-routine dysk-plus int (a int) (b int)) -(define-alien-routine dysk-plus1 int (n int)) -(dysk-hello) ;; => "hello from rust" -#+end_src -*** benchmark -#+begin_src shell -time target/release/dysk-test -#+end_src -#+begin_src lisp :tangle test.lisp -(time (dotimes (_ 500000000) (dysk-plus1 2))) -#+end_src diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20231124.org --- a/notes/20231124.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,33 +0,0 @@ -* cl-dot examples -#+begin_src lisp -(defmethod cl-dot:graph-object-node ((graph (eql 'example)) (object cons)) - (make-instance 'cl-dot:node - :attributes '(:label "cell \\N" - :shape :box))) -(defmethod cl-dot:graph-object-points-to ((graph (eql 'example)) (object cons)) - (list (car object) - (make-instance 'cl-dot:attributed - :object (cdr object) - :attributes '(:weight 3)))) -;; Symbols -(defmethod cl-dot:graph-object-node ((graph (eql 'example)) (object symbol)) - (make-instance 'cl-dot:node - :attributes `(:label ,object - :shape :hexagon - :style :filled - :color :black - :fillcolor "#ccccff"))) -(let* ((data '(a b c #1=(b z) c d #1#)) - (dgraph (cl-dot:generate-graph-from-roots 'example (list data) - '(:rankdir "LR" :layout "twopi" :labelloc "t")))) - (cl-dot:dot-graph dgraph "test-lr.svg" :format #+nil :x11 :svg)) -#+end_src - -#+RESULTS: - -#+begin_src lisp -(let* ((data '(a b)) - (dgraph (cl-dot:generate-graph-from-roots 'example (list data) - '(:rankdir "LR")))) - (cl-dot:print-graph dgraph)) -#+end_src diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20231205.org --- a/notes/20231205.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,5 +0,0 @@ -* global refs -need a way of indexing, referring to, and annotating objects such as -URLs, docs, articles, source files, etc. - -What is the best way to get this done? diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20231209.org --- a/notes/20231209.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,5 +0,0 @@ - -* doc best practices -https://rust-lang.github.io/api-guidelines/documentation.html - -also: https://lisp-lang.org/style-guide/ diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20231212.org --- a/notes/20231212.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,89 +0,0 @@ -* On Computers -If you've met me in the past decade, you probably know that I am -extremely passionate about computers. Let me first explain why. - -On the most basic level computers are little (or big) machines that -can be programmed to do things, or /compute/ if we're being -technical.[fn:1] - -They host and provide access to the Internet, which is a pretty big -thing, but they do little things too like unlock your car door and -tell your microwave to beep at you. They solve problems. Big or small. - -They're also /everywhere/ - which can be scary to think about, but -ultimately helps propel us into the future. - -There's something pretty cool about that - when you look at the -essence of computation. There are endless quantities of these machines -which follow the same basic rules and can be used to solve /real/ -problems. - -** The Programmer -Now, let us consider the /programmer/. They have power. /real/ -power. They understand the language of computers, can whisper to them -in various dialects. It can be intimidating to witness until you -realize how often the programmer says the wrong thing - a bug. - -In reality, the programmer has a symbiotic relationship with -computers. Good programmers understand this relationship well. - -#+begin_annecdote -One day after I got my first job at a software company, I remember -being on an all-hands meeting due to a client service outage. We had -some management, our lead devs, product team, and one curious looking -man who happened to be our lead IT consultant who had just joined. He -was sitting up on a hotel bed, shirtless, vaping an e-cig, typing -away in what I can only imagine was a shell prompt. - -After several minutes he took a swig from a bottle of Coke and said -"Node 6 is sick." then a few seconds later our services were -restored. For the next hour on the call he explained what happened and -why, but that particular phrase always stuck with me. He didn't say -Node 6 was down, or had an expired cert - his diagnosis was that /it/ -was /sick/. -#+end_annecdote - -The more you work closely with computers, the more you start to think -of them this way. You don't start screaming when the computer does the -wrong thing, you figure out what's wrong and learn from it. With -experience, you start to understand the different behaviors of the -machines you work with. I like to call this /Machine Empathy/. - -** Programs -I already mentioned bugs - I write plenty of those, but usually I try -to write /programs/. Programs to me are like poetry. I like to think -they are for the computer too. - -Just like computers, /computer programs/ come in different shapes and -sizes but in basic terms they are sets of instructions used to control -a computer. - -You can write programs to do anything - when I first started, my -programs made music. The program was a means to an end. Over time, I -started to see the program as something much more. I saw it as the -music itself. - -[fn:1] ... perform computations - - -* On Infra -Something that is missing from many organizations big or large, is an -effective way to store and access information, even about their own -org. - -It can be difficult problem to solve - usually there's the official -one, say Microsoft Sharepoint and then the list of unofficial sources -which becomes tribal corporate hacker knowledge. Maybe the unofficial -ones are more current, or are annotated nicely, but their very -existence breaks the system. There's no longer a single source of -truth. - -My priority in this department is writing services which process and -store information from a variety of sources in a distributed knowledge -graph. The graph can later be queried to access information on-demand. - -My idea of infrastructure is in fact to build my own Cloud. Needless -to say I don't have an O365 subscription, and wherever possible I'll -be relying on hardware I have physical access to. I'm not opposed to -cloud services at large but based on principle I like to think we -shouldn't be built on them. diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20231223.org --- a/notes/20231223.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,3 +0,0 @@ -* https://cal-coop.gitlab.io/utena/utena-specification/main.pdf -from the author of cl-decentralise2. draft specification of a -/Maximalist/ Computing System. diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20231224.org --- a/notes/20231224.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,4 +0,0 @@ -* public datasets -https://github.com/awesomedata/awesome-public-datasets -https://docs.openml.org/Datasets/ -https://wiki.pathmind.com/open-datasets diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20231228.org --- a/notes/20231228.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,40 +0,0 @@ -* useful internals -#+begin_src lisp - sb-sys:*runtime-dlhandle* - sb-fasl:+fasl-file-version+ - sb-fasl:+backend-fasl-file-implementation+ - sb-debug:print-backtrace - sb-debug:map-backtrace - sb-pretty:pprint-dispatch-table - sb-lockless: - sb-ext:simd-pack - sb-walker:define-walker-template - sb-walker:macroexpand-all - sb-walker:walk-form - sb-kernel:empty-type - sb-kernel:*eval-calls* - sb-kernel:*gc-pin-code-pages* - sb-kernel:*restart-clusters* - sb-kernel:*save-lisp-clobbered-globals* - sb-kernel:*top-level-form-p* - sb-kernel:*universal-fun-type* - sb-kernel:*universal-type* - sb-kernel:*wild-type* - sb-kernel:+simd-pack-element-types+ - (sb-vm:memory-usage) - (sb-vm:boxed-context-register) - (sb-vm:c-find-heap->arena) - (sb-vm:copy-number-to-heap) - (sb-vm:dump-arena-objects) - (sb-vm:fixnumize) - (sb-vm:rewind-arena) - (sb-vm:show-heap->arena) - (sb-vm:with/without-arena) - (sb-cltl2:{augment-environment,compiler-let,define-declaration,parse-macro}) - (sb-cltl2:{declaration-information, variable-information, function-information}) - sb-di: - sb-assem: - sb-md5: - sb-regalloc: - sb-disassem: -#+end_src diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20240103.org --- a/notes/20240103.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,27 +0,0 @@ -* [[https://github.com/sigmf/SigMF][SigMF]] -#+begin_quote -Sharing sets of recorded signal data is an important part of science -and engineering. It enables multiple parties to collaborate, is often -a necessary part of reproducing scientific results (a requirement of -scientific rigor), and enables sharing data with those who do not have -direct access to the equipment required to capture it. - -Unfortunately, these datasets have historically not been very -portable, and there is not an agreed upon method of sharing metadata -descriptions of the recorded data itself. This is the problem that -SigMF solves. - -By providing a standard way to describe data recordings, SigMF -facilitates the sharing of data, prevents the "bitrot" of datasets -wherein details of the capture are lost over time, and makes it -possible for different tools to operate on the same dataset, thus -enabling data portability between tools and workflows. -#+end_quote - -the-spec: https://github.com/sigmf/SigMF/blob/sigmf-v1.x/sigmf-spec.md -* [[https://www.libvolk.org/][LibVOLK]] -Vector-Optimized Library of Kernels (simd) -* [[https://docs.kernel.org/fb/framebuffer.html][/dev/fb*]] -framebuffers, used by fbgrab/fbcat program -* [[https://docs.kernel.org/block/ublk.html][ublk]] -https://github.com/ming1/ubdsrv diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/20240104.org --- a/notes/20240104.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,6 +0,0 @@ -goals: -make problems smaller. - -sections: -why lisp? -- doesn't need mentioning more and more diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/refs.bib --- a/notes/refs.bib Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,169 +0,0 @@ -@article{btrfs, -author = {Rodeh, Ohad and Bacik, Josef and Mason, Chris}, -year = {2013}, -month = {08}, -pages = {}, -title = {BTRFS: The linux B-tree filesystem}, -volume = {9}, -journal = {ACM Transactions on Storage (TOS)}, -doi = {10.1145/2501620.2501623} -} -@INPROCEEDINGS{zfs, - author={Rodeh, O. and Teperman, A.}, - booktitle={20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, 2003. (MSST 2003). Proceedings.}, - title={zFS - a scalable distributed file system using object disks}, - year={2003}, - volume={}, - number={}, - pages={207-218}, - doi={10.1109/MASS.2003.1194858}} - -@inproceedings{tmpfs, - title={tmpfs: A Virtual Memory File System}, - author={Peter Snyder}, - year={1990}, - url={https://api.semanticscholar.org/CorpusID:54156693} -} - -@Article{nvme-ssd-ux, -AUTHOR = {Kim, Seongmin and Kim, Kyusik and Shin, Heeyoung and Kim, Taeseok}, -TITLE = {Practical Enhancement of User Experience in NVMe SSDs}, -JOURNAL = {Applied Sciences}, -VOLUME = {10}, -YEAR = {2020}, -NUMBER = {14}, -ARTICLE-NUMBER = {4765}, -URL = {https://www.mdpi.com/2076-3417/10/14/4765}, -ISSN = {2076-3417}, -DOI = {10.3390/app10144765} -} - -@inproceedings{ext4, -author = {Djordjevic, Borislav and Timcenko, Valentina}, -title = {Ext4 File System Performance Analysis in Linux Environment}, -year = {2011}, -isbn = {9781618040282}, -publisher = {World Scientific and Engineering Academy and Society (WSEAS)}, -address = {Stevens Point, Wisconsin, USA}, -booktitle = {Proceedings of the 11th WSEAS International Conference on Applied Informatics and Communications, and Proceedings of the 4th WSEAS International Conference on Biomedical Electronics and Biomedical Informatics, and Proceedings of the International Conference on Computational Engineering in Systems Applications}, -pages = {288–293}, -numpages = {6}, -keywords = {Linux, journaling, ext4/ext3/ext2, filesystems, inodes, disk performances, file block allocation}, -location = {Florence, Italy}, -series = {AIASABEBI'11} -} - -@Article{hd-failure-ml, -AUTHOR = {Zhang, Mingyu and Ge, Wenqiang and Tang, Ruichun and Liu, Peishun}, -TITLE = {Hard Disk Failure Prediction Based on Blending Ensemble Learning}, -JOURNAL = {Applied Sciences}, -VOLUME = {13}, -YEAR = {2023}, -NUMBER = {5}, -ARTICLE-NUMBER = {3288}, -URL = {https://www.mdpi.com/2076-3417/13/5/3288}, -ISSN = {2076-3417}, -DOI = {10.3390/app13053288} -} - -@inproceedings{smart-ssd-qp, -author = {Do, Jaeyoung and Kee, Yang-Suk and Patel, Jignesh M. and Park, Chanik and Park, Kwanghyun and DeWitt, David J.}, -title = {Query Processing on Smart SSDs: Opportunities and Challenges}, -year = {2013}, -isbn = {9781450320375}, -publisher = {Association for Computing Machinery}, -address = {New York, NY, USA}, -url = {https://doi.org/10.1145/2463676.2465295}, -doi = {10.1145/2463676.2465295}, -booktitle = {Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data}, -pages = {1221–1230}, -numpages = {10}, -keywords = {smart ssd}, -location = {New York, New York, USA}, -series = {SIGMOD '13} -} - -@inproceedings{ssd-perf-opt, -author = {Zuck, Aviad and G\"{u}hring, Philipp and Zhang, Tao and Porter, Donald E. and Tsafrir, Dan}, -title = {Why and How to Increase SSD Performance Transparency}, -year = {2019}, -isbn = {9781450367271}, -publisher = {Association for Computing Machinery}, -address = {New York, NY, USA}, -url = {https://doi.org/10.1145/3317550.3321430}, -doi = {10.1145/3317550.3321430}, -booktitle = {Proceedings of the Workshop on Hot Topics in Operating Systems}, -pages = {192–200}, -numpages = {9}, -location = {Bertinoro, Italy}, -series = {HotOS '19} -} - -@article{flash-openssd-systems, -author = {Kwak, Jaewook and Lee, Sangjin and Park, Kibin and Jeong, Jinwoo and Song, Yong Ho}, -title = {Cosmos+ OpenSSD: Rapid Prototype for Flash Storage Systems}, -year = {2020}, -issue_date = {August 2020}, -publisher = {Association for Computing Machinery}, -address = {New York, NY, USA}, -volume = {16}, -number = {3}, -issn = {1553-3077}, -url = {https://doi.org/10.1145/3385073}, -doi = {10.1145/3385073}, -journal = {ACM Trans. Storage}, -month = {jul}, -articleno = {15}, -numpages = {35}, -keywords = {storage system, solid state drive (SSD), flash translation layer (FTL), Flash memory} -} - -@INPROCEEDINGS{emmc-mobile-io, - author={Zhou, Deng and Pan, Wen and Wang, Wei and Xie, Tao}, - booktitle={2015 IEEE International Symposium on Workload Characterization}, - title={I/O Characteristics of Smartphone Applications and Their Implications for eMMC Design}, - year={2015}, - volume={}, - number={}, - pages={12-21}, - doi={10.1109/IISWC.2015.8}} - -@inproceedings{xfs-scalability, - author = {Adam Sweeney and - Doug Doucette and - Wei Hu and - Curtis Anderson and - Mike Nishimoto and - Geoff Peck}, - title = {Scalability in the {XFS} File System}, - booktitle = {Proceedings of the {USENIX} Annual Technical Conference, San Diego, - California, USA, January 22-26, 1996}, - pages = {1--14}, - publisher = {{USENIX} Association}, - year = {1996}, - url = {http://www.usenix.org/publications/library/proceedings/sd96/sweeney.html}, - timestamp = {Wed, 04 Jul 2018 13:06:34 +0200}, - biburl = {https://dblp.org/rec/conf/usenix/Sweeney96.bib}, - bibsource = {dblp computer science bibliography, https://dblp.org} -} - -@inproceedings{xfs, - title={xFS: A wide area mass storage file system}, - author={Wang, Randolph Y and Anderson, Thomas E}, - booktitle={Proceedings of IEEE 4th Workshop on Workstation Operating Systems. WWOS-III}, - pages={71--78}, - year={1993}, - organization={IEEE} -} - -@inproceedings {zns-usenix, -author = {Matias Bj{\o}rling and Abutalib Aghayev and Hans Holmberg and Aravind Ramesh and Damien Le Moal and Gregory R. Ganger and George Amvrosiadis}, -title = {{ZNS}: Avoiding the Block Interface Tax for Flash-based {SSDs}}, -booktitle = {2021 USENIX Annual Technical Conference (USENIX ATC 21)}, -year = {2021}, -isbn = {978-1-939133-23-6}, -pages = {689--703}, -url = {https://www.usenix.org/conference/atc21/presentation/bjorling}, -publisher = {USENIX Association}, -month = jul, -} \ No newline at end of file diff -r c099290dcde9 -r 6e1e5ecd7bd3 notes/vocab --- a/notes/vocab Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,19 +0,0 @@ -;;; docs/vocab --- project glossary -*- mode:outline;outline-regexp:"[-]+" -*- -- wrt : With Respect To -- nyi : Not Yet Implemented -- rt : Regression Testing -- vm : Virtual Machine -- asm : Assembly -- comp : Compiler -- eval : Evaluate -- alloc : Allocate -- ret : Return -- tco : Tail-call Optimization -- reg : Register -- sbcl : Steel Bank Common Lisp -- rs : Rust (the language) -- el : Emacs Lisp -- cl : Common Lisp -- pcl : Practical Common Lisp -- taomop : The Art of the Meta Object Protocol -- lol : Let Over Lambda diff -r c099290dcde9 -r 6e1e5ecd7bd3 pitch.org --- a/pitch.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,4 +0,0 @@ -{{{header(pitch, -Richard Westhaver, -ellis@rwest.io, -The Big Picture)}}} diff -r c099290dcde9 -r 6e1e5ecd7bd3 readme.org --- a/readme.org Wed Jan 10 19:02:43 2024 -0500 +++ b/readme.org Tue Apr 30 22:16:29 2024 -0400 @@ -6,5 +6,5 @@ * [[file:blog][blog]] ** [2023-11-19 Sun] [[https://compiler.company/blog/hello-world][hello-world]] * [[file:docs][docs]] -* [[file:roadmap.org][roadmap]] -* [[file:pitch.org][pitch]] +* [[file:roadmap][roadmap]] +* [[file:pitch][pitch]] diff -r c099290dcde9 -r 6e1e5ecd7bd3 roadmap.org --- a/roadmap.org Wed Jan 10 19:02:43 2024 -0500 +++ /dev/null Thu Jan 01 00:00:00 1970 +0000 @@ -1,16 +0,0 @@ -{{{header(roadmap, -Richard Westhaver, -ellis@rwest.io, -The Compiler Company Roadmap)}}} -* WIP 2023 -SCHEDULED: <2023-01-01 Mon>--[2023-12-31 Tue] -- State "WIP" from [2023-11-05 Sun 21:47] -** TODO NAS-T charter -- State "TODO" from [2023-11-05 Sun 21:51] -** TODO compiler.company web services -- State "TODO" from [2023-11-05 Sun 21:52] -** TODO hello-world blog post -- State "TODO" from [2023-11-05 Sun 21:53] -* TODO 2024 -SCHEDULED: <2024-01-01 Mon>--[2024-12-31 Tue] -- State "TODO" from [2023-11-05 Sun 21:47]