Absolutely sick!!! Love this so much. I’m on a journey to have my own homelab via a k8s setup so that I would have project experience and qualifications for a DevOps engineering job. I’ve also seen people use LocalStack to essentially emulate AWS and set up homeland via LocalStack and k8s to get project experience. That’s next up for my list!

They’re contractors, I’m supposed to approve/deny said contractors

Thank you! Will look into this

They don’t have huge clients, just a steady flow. 3 locations due to small 5-7 person groups per office instead of one big office. Tbh idk why they do it like that lol

Kinda, kinda not? The lawyer who owns the firm really wants new Ai features and asks about stuff all the time, but he doesn’t necessarily have a specific goal, rather, just gives times to create automations with reports or whatever

That’s what I was thinking, they were saying that a 5070 Ti would be good enough for “whatever Ai automations the firm wants to build” which is where I was calling BS

That’s what I was thinking too, I’m pretty sure just using the API for those models or a VM with a GPU like you said would be the only viable options

I’m not an expert at all, I’ve never built out an enterprise system before so that’s why I wanted to verify.

I know you can run really small models on some 16gb VRAM cards, so I didn’t know if people use tiny models for very basic automation systems or something. I haven’t heard of that being viable but wanted to sanity check myself

The lawyer who owns the firm has me approve all tech vendors. I have not built out my personal homelab, know l some jargon and theory, but don’t have practical experience here.

Saw red flags and wanted to verify cause it’s part of my role

early on, so you don’t have to convert all your services at once but can integrate them when you set them up.

For this part, i’m not sure what you mean by convert all my services? are you talking like a 2FA app or similar?