2024-06-10 - KDB Project Call Meeting Minutes

[alvin-c-shih]

Date

Monday, June 10, 2024 - 9:30am ET / 2:30pm UK

// Second Monday of every month

Attendees

Fullname	Affiliation	GitHub Username
Karl Moll	FINOS	@karlmoll
Aaron Davies	Morgan Stanley	@adavies42
Ian O'Dwyer	KX Systems	@iodwyer
Peter Gyorok	KX Systems	@gyorokpeter
Ross Duffy	Morgan Stanley	@rdffy
Gary Davies	Data Intellect	@drgdavies
Alvin Shih	Morgan Stanley	@alvin-c-shih

Meeting notices

• FINOS Project leads are responsible for observing the FINOS guidelines for running project meetings. Project maintainers can find additional resources in the FINOS Maintainers Cheatsheet.

• All participants in FINOS project meetings are subject to the LF Antitrust Policy, the FINOS Community Code of Conduct and all other FINOS policies.

• FINOS meetings involve participation by industry competitors, and it is the intention of FINOS and the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Please contact [email protected] with any questions.

• FINOS project meetings may be recorded for use solely by the FINOS team for administration purposes. In very limited instances, and with explicit approval, recordings may be made more widely available.

Agenda

• (5 min) Convene, roll call, welcome new people.

• Display FINOS Antitrust Policy summary slide

• Review Meeting Notices (see above)

• (5 min) Approve previous meeting minutes.

• (10 min) TurinTech applicable to kdb+?

  • https://www.turintech.ai/

  • Seems I/O would be hard for a software tool to optimize by just looking at the code:

    • SSDs vs spinning disk? SSDs cost 10x.
    • Local vs network.
    • Native q vs C plugin.
    • .Q.MAP[] and understanding various levels of compression.
    • How much of a splayed table is read for a given query?
    • Integration with I/O measurements and other hooks would be required.

  • Some looking at software optimization from an ESG angle.

    • OS-Climate joining FINOS!
    • https://www.finos.org/os-climate
    • AI-Readiness may also look at sustainability due to the amount of GPU compute used for LLMs.
    • May have tie-ins with Modernization.
    • Various discussions in industry about Technology Sustainability Frameworks.
    • Texas and Florida unfriendly to ESG?
      • https://knowledge.wharton.upenn.edu/podcast/knowledge-at-wharton-podcast/texas-fought-against-esg-heres-what-it-cost/
      • https://www.flgov.com/2022/08/23/governor-ron-desantis-eliminates-esg-considerations-from-state-pension-investments/

• (10 min) Contributor License Agreement in the context of contractors / consultants doing enhancements for users at banks.

  • Does the contractor fall under the CLA of the bank?
    • FINOS legalese does not prevent it, but internal bank policy may be been worded in terms of "employees" and may need revision to include contractors.
  • CLA process can drag out:
    • Contributor's approver in the company is usually highly placed in the legal department and is not available 99% of the time.
    • The FINOS side of the workflow has been known to return errors.
    • Please report problems with the CLA process to mailto:[email protected] .

• (10 min) HN : Arthur Whitney releases an open-source subset of K with MIT license (shakti.com)

  • https://news.ycombinator.com/item?id=40544283
  • https://shakti.com/edu
    • May need to macro expand and indent to understand.
  • Can use AI Coding Assistant like GitHub Copilot / Sourcegraph Cody to help explain.
    • According to this, GPT-3 can explain assembly language:
      • https://medium.com/tenable-techblog/g-3po-a-protocol-droid-for-ghidra-4b46fa72f1ff

• (5 min) HN : BQN: Finally, an APL for your flying saucer](https://mlochbaum.github.io/BQN/)

  • https://news.ycombinator.com/item?id=33180842

  • https://mlochbaum.github.io/BQN/tutorial/expression.html

  • Backports some features from k / q.

  • Borrows tacit programming?

  • Lightweight anonymous functions from lisp.

  • Code golfing languages:

    • Purportedly one out there that encodes 100,000 operators as Unicode characters (including Chinese).
    • "Sudoku solver" in k:
      • https://blog.singleton.io/sudoku/
    • Operator in q only works for 3x3 case but works in the general case for k.

• (5 min) GitHub Copilot trick #file:

  • Can be used to feed large prompt with q programming language details into the LLM.
  • https://code.visualstudio.com/docs/copilot/getting-started-chat
  • Demo here: YouTube : GitHub Copilot just got exponentially smarter
    • https://www.youtube.com/watch?v=SZVCJRUADc4

• (5 min) AOB, Q&A, Adjourn.

Join Zoom Meeting

• https://zoom.us/j/94523415326?pwd=NkJDaUtUUlZTcHVwcUJHdG0yRFJUdz09
• Meeting ID: 945 2341 5326
• Passcode: 361990
• Find your local number: https://zoom.us/u/abTtYRZ0B6

[rianoc-kx]

Rian Ó Cuinneagáin / KX

[adavies42]

Aaron Davies/Morgan Stanley

[gyorokpeter]

Péter Györök / KX

[drgdavies]

Gary Davies / Data Intellect

[rdffy]

Ross Duffy / Morgan Stanley

[rianoc-kx]

• https://groups.google.com/g/shaktidb
• https://www.arraycast.com/episodes
• https://code.kx.com/pykx/2.5/roadmap.html

[alvin-c-shih]

Alvin Shih / Morgan Stanley