• 0 Posts
  • 40 Comments
Joined 1 year ago
cake
Cake day: August 4th, 2023

help-circle
  • I don’t believe this is quite right. They’re capable of following instructions that aren’t in their data but appear like things which were (that is, it can probabilistically interpolate between what it has seen in training and what you prompted it with — this is why prompting can be so important). Chain of thought is essentially automated prompt engineering; if it’s seen a similar process (eg from an online help forum or study materials) it can emulate that process with different keywords and phrases. The models themselves however are not able to perform a is to b therefore b is to a, arguably the cornerstone of symbolic reasoning. This is in part because it has no state model or true grounding, only probabilities you could observe a token given some context. So even with chain of thought, it is not reasoning, it’s just doing very fancy interpolation of the words and phrases used in the initial prompt to generate a prompt that is probably going to give a better answer, not because of reasoning, but because of a stochastic process.





  • While this is true, algorithmic feeds virtually guarantee that echo chambers exist within a platform already. Fascists won’t leave YouTube because they feel it’s “too woke” or offering varying viewpoints, they’ll leave because the people they already watch there tell them to go to the other service. So I think it’s possible Elon attracts the fascists, destroys YouTube’s ability to monetize that part of their algorithm, and consequently have to improve service for others to try and ensure other fringe echo chambers don’t follow suit.



  • How big is this controller? I have wide palms but shortish fingers. From palm to tip of middle fingers like 7.5”, which is low side of male hands, but 4” wide palm which is above average. Makes finding ergonomic controllers difficult. I can reach the middle of controllers without too much difficulty, but reaching lengthwise (eg the shoulder buttons) can be problematic (perhaps why I like the ps4 controller — it’s wide but squat; it just lacks usability with no back buttons, and it only pairs to a single device at a time). I guess a smaller Xbox style controller would work okay for me — is Wolverine worth a try you think?


  • I’m personally looking for a Hall effect joystick, ps5 style layout, wireless capable, plays nice with Linux game controller. Seems like I’ve seen flydigi as a potential option, and maybe some 8bitdo ones. Maybe scuf?

    One major issue I’ve had is my ps4 controller doesn’t have multipoint, meaning it will only Bluetooth pair to a single device at a time. Wanna use it on your phone? Gotta pair it. Wanna use it again on your pc — yep, gotta pair it again. Reaaaaallly annoying.


  • They don’t, but with quantization and distillation, as well as fancy use of fast ssd storage (they published a paper on this exact topic last year), you can get a really decent model to work on device. People are already doing this with things like OpenHermes and Mistral (given, 7B models, but I could easily see Apple doubling ram and optimizing models with the research paper I mentioned above, and getting 40B models running entirely locally). If the start of the network is good, a 40B model could take care of a vast majority of user Siri queries without ever reaching out to the server.

    For what it’s worth, according to their wwdc note, they’re basically trying to do this.




  • Almost. If you own a share of a company, you own a share of something fungible, namely literal company property or IP. Even if the company went bankrupt, you own a sliver of their real product (real estate, computers, patented processes). So while you may be speculating on the wealth associated with the company, it is not a scam in the sense that it isn’t a non fungible entity. The sole value of crypto currency is in its speculative value, it is not tied in theory or in practice to something of perceptibly equal realized value. A dividend is just giving you return on profit made from realized assets (aforementioned real estate or other company property or processes), but the stock itself is intrinsically tied to the literal ownership of those profit generating assets.









  • It may be no different than using Google as the search engine on safari, assuming I get an opt out. If it’s used for Siri interactions then that gets extremely tricky for one to verify that your interactions aren’t being used to inform adds and or train an LLM. Much harder to opt out vs default search engine there, perhaps.

    LLMs do not need terabytes of ram. Heck you can run quantized 7billion param models on 16gb or less (Bloom, Falcon7B — falcon outperforms models with higher memory by the way, so there’s room here for optimization). While not quite as good as openAIs offerings, they’re still quite good. There are Android phones with 24gb of ram so it’s quite possible for Apple to release an iPhone pro with that much, and run it similar to running any large language model on an M1 or M2 Mac. Hell you could probably fit an inference only model in less. Performance wouldn’t be blazing but depending on the task, it could absolutely be sufficient. With Apple MLX and Ferret coming online it’s totally possible that you could, basically today, have a reasonable LLM running on an iPhone 15 Pro. People run OpenHermes 7B for example which uses ~4.4GB to run, without those frameworks. Battery life does take a major hit, but to be honest I’m at a loss for what I need an LLM for on my phone anyways.

    Regardless, I want a local LLM or none at all.