Lionel

Research Scientist. Houston, TX. Research interests: Complexity Sciences, Matrix Decomposition, Clustering, Manifold Learning, Networks. https://www.lionelyelibi.com/ 🇺🇸🇨🇮🇿🇦

Articles & links

↻ Lionel reposted
Al Merose @al.merose.com

Sneak peek: I implemented a 3 layer MLP that predicts the fashion MNIST dataset using SQL (with my own autograd impl inside the database). Apparently einsum notation is better expressed as a JOIN. github.com/xqlsystems/x...

xarray-sql/benchmarks/nn.py at claude/xarray-sql-mnist-demo · xqlsystems/xarray-sql github.com
AI Weekly's analysis →
  • The benchmark trains a 784→196→32→10 MLP on Fashion-MNIST with forward pass, backpropagation, and SGD all expressed as SQL queries.
  • A SKIP_ZERO_PIXELS flag drops background pixels via a WHERE clause and delivers roughly a 1.8x speedup on Fashion-MNIST.
  • Hyperparameters are demo-scale: 500 training samples, 200 test samples, learning rate 0.5, 60 steps, chunk size 250.
Read full analysis →
View on Bluesky →

Recent commentary

if you think ai is going in the wrong direction maybe you can work on those things which you believe would push the field in the right one. Instead of incessantly criticizing and complaining about everybody else doing work. Ship something and publish possible improvements.

View on Bluesky · ♥ 0 ↻ 0 ↩ 1 · 44d ago

what I love and hate about ai is that this is basically a sort of complicated autoencoder/nonlinear pca except it's a foundation model:

View on Bluesky · ♥ 1 ↻ 0 ↩ 0 · 22d ago

With the creation of communities and group chats, I think the ML/AI communities on here will be better insulated from much of the vitriol on this platform from now on since those significantly improve privacy and moderation. Exciting stuff.

View on Bluesky · ♥ 1 ↻ 0 ↩ 0 · 26d ago

Eventually users should be able to locally host frozen version of LLMs. I don't know how you avoid losing your mind suspecting model updates of performance degradation without proper evaluation methods (also why do you even have to do that to begin with?).

View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 7h ago

quick question for anybody who is into this: in the current environment when it comes to neural network model compression quantization methods are being prefered to pruning ?

View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 18d ago

In Lionel's orbit

Center = Lionel. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.