With batched parallel requests this scales down further. Even a MacBook M3 on battery power can do inference quickly and efficiently. Large scale training is the power hog.

I was daydreaming of a special LLM setup wherein each token of the vocabulary appears twice. Half the token IDs are reserved for trusted, indisputable sentences (coloured red in the UI), and the other half of the IDs are untrusted.

Effectively system instructions and server-side prompts are red, whereas user input is normal text.

It would have to be trained from scratch on a meticulous corpus which never crosses the line. I wonder if the resulting model would be easier to guide and less susceptible to prompt injection.

Even if you don't fully retrain, you could get what's likely a pretty good safety improvement. Honestly, I'm a bit surprised the main AI labs aren't doing this

You could just include an extra single bit with each token that represents trusted or untrusted. Add an extra RL pass to enforce it.

Yeah, myself and several friends of mine with EOL Windows 10 PCs are looking to jump ship.

MacBooks outclass any other laptop in the market thanks to those chips.

We can spend more time on art, music, camaraderie, love, play, and the pursuit of grace.

None of which is possible without the lived experiences of problem solving.

Playing games, creating art, and pursuing love ARE the lived experience of problem solving… for me, at least. Probably not for everyone.

Yeah my point was that without everyday challenges they lose meaning.

How does one create art without understanding struggle? How can someone find love without knowing how to keep it alive?

People need to make mistakes and then reflect deeply on them. We need to integrate our experiences with our beliefs and values in order to find meaningful expression.

I think the only exception to all of this might be abstract puzzles.

That won't happen, don't kid yourself

The same thing will happen to us that happens to surplus livestock

apparently this is the source: https://youtu.be/1L2ef1CP-yw

The fan increases air speed at the centre of the rotor, creating a low pressure zone which then sucks in surrounding air. So it helps to place the fan away from the window (roughly far enough that the wind cone "fits" the opening).

I would have loved to see that video 2 months ago. Thanks for sharing.

I tried to put the same kind of desk fan at the window, one way and then the other, for a few hours, to see if it had any effect. It was a very hot day but colder outside than inside. The building's concrete was likely still radiating the heat from the day before and there was no wind.

I see now that my observation at the time was right: it did nothing to the temperature, and it might have worked better if I had put the fan 1-2 meters away from the window, directing it towards the window. Now, whether the effect would have been significant anyway… we'll have to wait for next summer to know, I guess. I'm not particularly looking forward to it, though.

A 20 or 24" box fan still moves a LOT of air- you should get a decent breeze if you guide the air. the largest mistake I see is forgetting that a fan can't blow if theres no air coming or going- you need openings of equal size (larger is better) between where the fan is and where you want the air to come from/go.

An easy mental model is imaging the air is water. Close a door on a room and it'll fill up and block the hose.

PS: a box fan and a 5" thick MERV13 filter makes a heck of an air filter. 2" likely also will work. MERV13 is great, but some HVAC can't handle it, and it takes a couple passes (term is air exchanges per hour, I think) to capture what HEPA does in a single pass.

Yep, I had all my windows and doors open.

Not sure then. Maybe concrete really is too hot. Where I am adobe (clay, not company) buildings have traditionally been used in some areas to even out temperatures (desert region. Too hot in the day, too cold at night).

This stuff is a dream of mine, editors in different modes that can collaborate seamlessly. Keep up the good work!

I think we need a spatial/physics model handling movement and tactics watched over by a high level strategy model (maybe an LLM).

What’s wild to me is that we have basically manifested the Babel Fish in the last few years.

Huh? We've had pretty good translation in some languages in many general purpose contexts for a while. The LLM stuff if you're referring to that to my knowledge only has some gains in some languages in some contexts. Which is exciting no doubt.

Compared to google translate of yore, it’s gotten way more fluent thanks to transformers. Good translation relies heavily on context of course. Voice recognition and text to speech quality have increased dramatically. And near real-time (or as real-time as is possible given a pair of languages) is becoming feasible.

For sure, just the gains of LLMs in the mix cannot be measured and most still recommend human in the loop as always.

Meanwhile Switzerland is implementing e-ID which gives citizens private and public keys so they can sign and prove things without leaking their whole identity.

The USPS, with their existing delivery infrastructure and massive presence, would be a great fit for doing this in the US. Think like DoD CAC cards, but for ordinary citizens.

It'll never happen, though.

You don't think the USPS is on the chopping block?? The new Postmaster General is from the FedEx BOD. https://www.commondreams.org/news/david-steiner-postal-servi...