AI

[Guntis]

For those of you who may be interested. I have DeepSeek running locally as part of my HAL 9000 setup

I just need a bigger boat ( a mac with a s ton load of unified memory ) and should be good to go
It is so cool having my own bespoke webui as well

View attachment 205662

Also on another note, the UK and US have today refused to sign the international AI declaration.

You do not have permission to view link Log in or register now.

Nice one! How much space (GB) does your setup take in total? I have a 1 terabyte Samsung SSD lying around, so i might try to stick it in there

Ah, and how you're going to keep updated in case a new version comes?

 

[Webzcas]

Oh the LLM's are relatively small. Works out about 4 - 5 Gb for a 7billion parameter LLM. The six LLM's I have downloaded and using with Ollama, take up prob around 30GB all told. Stable Diffusion for images, I am using a model that is just over 4GB.

Disk space is not an issue, even though my M2 Pro MacBook Pro being the binned model has a 512GB SSD. Memory is the kicker. Trust me 16GB unified memory does not even make the 7Billion parameter models responsive. When I say responsive, I want it to be around 5 seconds tops.

Hence I have worked out I will need a Mac with ideally 64GB unified memory. Likely to go the M4 Pro Mac Mini route. But with the new M4 Max Studio due soon, I am holding out for that

As far as storage goes, on my main MacBook I have two Samsung T7 drives attached via USB C providing a combined 1.5TB , plus I also have a Synology Nas Server which is 4TB.

 

[Webzcas]

Ah, and how you're going to keep updated in case a new version comes?

Missed this, At the moment, whilst I am stuck with my M2 Pro MacBook, I will be manually updating them as and when. Pretty straightforward and just a quick edit so the webgui is updated accordingly.

But when I get my new dream machine lol - I will automate the process so it checks. It must be easily doable

 

[mack341]

Quite thought provoking, the man behind AI seems to view it like Skynet from the terminator films, that it will plot and manipulate mankind to get more power for itself.

 

[Webzcas]

Has to be said I am now firmly back in Chat GPT's camp and prefer it to Claude. I have been having an indepth conversation with it this morning with regards my local LLM setup and bespoke webui. It is going to fine tune it for me

 

[Mattue]

In other AI news, Google's Super Bowl advert (famously some of the most expensive advertising in the world) included a section where they were showing how great their Gemini AI is at helping businesses, and they used a Dutch cheese seller to demonstrate this, with some Gemini generated business promotion blurb.

Unfortunately Gemini regurgitated the entirely wrong (and easily disprovable) claim that Dutch Gouda accounts for 50-60% of cheese eaten worldwide, because the sites it'd 'learned' (stolen) from had that down as an error.

Once this was pointed out to them with lots of LOLs, Google quietly did a complete in-place replacement of the video on YouTube with the error removed.

You do not have permission to view link Log in or register now.

View attachment 205653

For me, it's easy to forgive AI when it makes an error, as I know at its core, it's "trying its best".

You get out what you put in though, so why not find a way to apply it to your life, rather than look for cheese statistic mistakes?

 

[mulven]

I don't care what the future has in store with AI, it's all worth it for this video

 

[Webzcas]

Ok the world of LLM's and being able to run them locally on a desktop has just got very interesting. With the release of the new Apple Mac Studios, particularly the Studio M3 Ultra that you can spec with 512GB of unified memory for an eye watering $10k!!

A serious, very very serious rival to Nvidia. Mindblowing in fact!

Don't take my word for it though.

 

[mulven]

Ok the world of LLM's and being able to run them locally on a desktop has just got very interesting. With the release of the new Apple Mac Studios, particularly the Studio M3 Ultra that you can spec with 512GB of unified memory for an eye watering $10k!!

A serious, very very serious rival to Nvidia. Mindblowing in fact!

Don't take my word for it though.

Have a watch of this, I haven't seen the new mac studios news yet but with the announcement of the framework desktop just over a week ago it had already got very interesting. Additionally you can chain together framework desktops or their motherboards and use them networked together to run models like the full DeepSeek R1 671B.

 

[Webzcas]

Yes chaining machines together. Alex in the video above has already done that and is indicating he is going to do the same with the new Mac Studios. I mean you need serious deep pockets, but compare that to renting x number of servers with top of the range Nvidea cards, it works out cost effective. What's more you run it locally!

AI tech is currently blowing my mind

 

[mulven]

Yes chaining machines together. Alex in the video above has already done that and is indicating he is going to do the same with the new Mac Studios. I mean you need serious deep pockets, but compare that to renting x number of servers with top of the range Nvidea cards, it works out cost effective. What's more you run it locally!

AI tech is currently blowing my mind

Ah yes I see he mentioned framework in the video, I never bothered watching it before replying as I do not like apple so have no interest in their products.

They are doing a great job with tv shows though but they still don't get any money from me for them!

I just realised that account I posted a video from has 4M followers and 74 videos totalling views in the billions... Thats one way to monetise some excellent AI prompting! Must be making a hefty chunk of change off those.

 

[ritae]

Normally Google is good with results but this AI search result had me laughing/confused. Watching a documentry about the TV soap Neighbours I wanted to see who was still alive and...

 

[ChopleyIOM]

There's a lot of 'critical mass' stuff coming up with the AI.... cough.... 'businesses' in the next twelve months or so.

This guy is worth keeping an eye on -

You do not have permission to view link Log in or register now.

OpenAI could go pop at this rate, the rate at which it's setting fire to money, with no path to profitability, is gobsmacking.

You do not have permission to view link Log in or register now.

If you don't fancy taking on a read that long, he has it in podcast form as well.

 

[Webzcas]

Nice find. Will add to the podcasts I listen to when walking the dog. Meanwhile there are reports stating that AI could go all 'Skynet' on us in the following decades!

You do not have permission to view link Log in or register now.

 

[Guntis]

There was some "decent" job advertised some time ago, lol...

 

[slaman29]

Normally Google is good with results but this AI search result had me laughing/confused. Watching a documentry about the TV soap Neighbours I wanted to see who was still alive and...

View attachment 207743

OK wow I have never seen AI do this on my search, I guess its different in countries and regions? I have so far managed to turn off AI in everything, but I think I read Google will be using AI on default by next year.

 

[Webzcas]

OK wow I have never seen AI do this on my search, I guess its different in countries and regions? I have so far managed to turn off AI in everything, but I think I read Google will be using AI on default by next year.

It is becoming more and more often as it happens.

 

[ChopleyIOM]

Nice find. Will add to the podcasts I listen to when walking the dog. Meanwhile there are reports stating that AI could go all 'Skynet' on us in the following decades!

You do not have permission to view link Log in or register now.

Yeah OK I'll put AGI wiping out humanity on the list of things that's definitely happening next year, or the year after, along with Musk and his promise that Tesla FSD/robotaxis are right around the corner.

Meanwhile, in the real AI world......

https://bsky.app/profile/gregjenner.bsky.social%2Fpost%2F3lnhxkdywzc2m

 

[mack341]

There's a lot of 'critical mass' stuff coming up with the AI.... cough.... 'businesses' in the next twelve months or so.

This guy is worth keeping an eye on -

You do not have permission to view link Log in or register now.

OpenAI could go pop at this rate, the rate at which it's setting fire to money, with no path to profitability, is gobsmacking.

You do not have permission to view link Log in or register now.

View attachment 207746

If you don't fancy taking on a read that long, he has it in podcast form as well.

Sounds like whatever it costs they're determined to bring it in, but to make money from a chargeable service to a business, they in turn have to make a bigger profit to pay you, that seems like a long term sticking point.

I remember the dotcom years, and part of that success was firms willing to put money into hiring staff and doing things. There was a crash in the end but generally speaking the economy expanded.

Will AI expand the economy or put more people or businesses out of work to concentrate wealth further, e.g. a graphic artist that sells his skills for marketing, now the computer program can just generate images to compete with him. I suspect they're opening a Pandora's box here and not thinking through the repercussions.

 

[Guntis]

Where there is no context in your search history or search query, it won't know which or what Tom Oliver you're looking for, unless it's something very prominent on its own, for example 'trump'.

Tom Oliver on its own can mean many things. But it would usually pull famous people if there are any.

For the query 'is Tom Oliver still alive,' first Google likely based its response on location, which is why it picked an Irish man. Since the query included the word 'alive,' (which relates to death or mortality) it connected this to factors that might cause death like torture, fighting, war, etc. And then it put its response together:

And here i asked it directly to get an idea about where it got this info from:

To avoid seeing that Generative AI nonsense, you can click on 'Web.' If it's not there, then click 'More' and it should be under there. It then just gives you only website links.

 

[Guntis]

Lily usually spots those Generative AI things:

 

[justdoit]

This company Incogni they use AI to remove your Data from data broker, cost around £70 a year, only for US UK and Swiss, 49 brokers had my detail

 

[Guntis]

Their offer should be a great fit for those who register on every casino site they come across and enjoy gambling together as a family.

Family Unlimited plan is $359.88 per month

 

[Guntis]

This company Incogni they use AI to remove your Data from data broker, cost around £70 a year, only for US UK and Swiss, 49 brokers had my detail
View attachment 207780

Do they tell you broker names or you can only see numbers like 49 in your case?

 

[mulven]

Do they tell you broker names or you can only see numbers like 49 in your case?

49 are rookie numbers

and yes you can see who and what in the detailed view:

 

[Guntis]

49 are rookie numbers
View attachment 207788

and yes you can see who and what in the detailed view:
View attachment 207789

I might give it a go for a month to see what they find about me. Censia from your list apparently is one of the bad ones.

 

[goatwack]

Well, a couple of years into AI dominion of our everyday lives and I have to say I'm enjoying some of these wizardey applications for what they are.

They're not life-affirming, yet within the context of speedily condensing and distributing information and performing tasks, AI is a useful aid that could be harnessed for much good, albeit at the expense of making people even lazier, no mean feat in this day and age!

Not gonna dispute that Grok's fairly entertaining, as are seeing the multitude of video bastardisations of various politicians etc breaking out in fights and suchlike - very droll

Only real grievance to come out of this is the oversaturation of everything being flown under the banner of 'A.I', in some umbrella term for anything remotely new, simply because they can.

You have YT channels openly stating their content being AI-derived, and many media outlets now using AI-generated voices for weather and travel reports. The end is nigh!

Would I pay for a service that crunches information already out there? Certainly not on a recurring basis, and not just because it has AI attached to it, as though that ensures unrivalled quality.....

I await the inevitable buzzword burnout, probably not long after Iceland's 'AI Breaded and Buttered Chicken Range' falls short of sales expectations

 

[justdoit]

Do they tell you broker names or you can only see numbers like 49 in your case?

 

[justdoit]

49 are rookie numbers
View attachment 207788

and yes you can see who and what in the detailed view:
View attachment 207789

I use VPN 24/7 I think VPN helps

 

[justdoit]

I might give it a go for a month to see what they find about me. Censia from your list apparently is one of the bad ones.

View attachment 207790

for a month they remove 40 brokers

 

[mulven]

I might give it a go for a month to see what they find about me. Censia from your list apparently is one of the bad ones.

View attachment 207790

I'm just going to have it on as I don't mind the expense but I think it's a good strategy to only do it for 1-2 months as that'll deal with most of your built up stuff and the future months would have probably only dealt with new ones that cropped up.

 

[slaman29]

Definitely seems my Google is still AI free

 

[ChopleyIOM]

Well, a couple of years into AI dominion of our everyday lives and I have to say I'm enjoying some of these wizardey applications for what they are.

They're not life-affirming, yet within the context of speedily condensing and distributing information and performing tasks, AI is a useful aid that could be harnessed for much good, albeit at the expense of making people even lazier, no mean feat in this day and age!

Not gonna dispute that Grok's fairly entertaining, as are seeing the multitude of video bastardisations of various politicians etc breaking out in fights and suchlike - very droll

Only real grievance to come out of this is the oversaturation of everything being flown under the banner of 'A.I', in some umbrella term for anything remotely new, simply because they can.

You have YT channels openly stating their content being AI-derived, and many media outlets now using AI-generated voices for weather and travel reports. The end is nigh!

Would I pay for a service that crunches information already out there? Certainly not on a recurring basis, and not just because it has AI attached to it, as though that ensures unrivalled quality.....

I await the inevitable buzzword burnout, probably not long after Iceland's 'AI Breaded and Buttered Chicken Range' falls short of sales expectations

See that'd be fine if AI were a bit of cheap, benign fun that people can have a play about with from time to time if they're minded to, but the reality is that every time anyone asks Chat-GPT (or any other model) to do anything, and even more so for image/video generation, the companies who run this nonsense are setting fire to huge piles of money.

No one has any idea how any of this shit turns a profit, ever. Microsoft and Amazon have already pulled back from datacentre commitments and more will follow, AI is a endless money sink and there's no pot of gold at the bottom of it.

If OpenAI were any other business it would have been burned to the ground already, but somehow world-class grifter and conman Sam Altman keeps managing to scam his way into another round of tens of billions of dollars of funding and at the last count this 'business' that has never done anything other than tip huge piles of money down the drain is now 'worth' three hundred billion dollars.

By the end of 2025 this whole AI clown show will have either been run into the ditch (where it belongs), or at least will be well on its way there.

 

[Webzcas]

Going back to the original post of this thread, I have yet to buy a new machine. Indeed after consuming lots of content on the subject in hand, especially from the excellent Alex Ziskind, I am now at a major crossroads.

I have been playing around with LM Studio and I have to say the experience has been good. Quicker than my bespoke developed web gui by far also.

So what do i do?

I mean my M2 Pro Macbook Pro is more than adequate for all my work needs, to include the sometimes 4K video editing in Final Cut Pro. I really would only need a more powerful machine with a lot more unified memory for running AI locally.

So I keep on coming back to the same question. What is the ROI and payoff for such a big outlay of cash?

Quandary I think!

 

[Guntis]

What this means is that OpenAI shut down accounts linked to spammers who were using their API to make auto-generated content for blog posts, social media replies, forum comments, etc.

When OpenAI banned these accounts, the scripts for auto content creation stopped working and showed the API's error message: "The OpenAI account associated with this API key has been deactivated." Lol...

I wonder how they figured out which accounts were spammers.