117 lines
4.7 KiB
Markdown
117 lines
4.7 KiB
Markdown
# Platform Setup — Profiles, Rates, Checklist
|
||
|
||
## Target platforms (3, not spread thin)
|
||
|
||
1. **Upwork** — highest-intent freelance gigs (Proxmox/AI infra buyers actively hire here)
|
||
2. **Reddit** — reputation + inbound (r/homelab, r/selfhosted, r/LocalLLaMA, r/ollama)
|
||
3. **Gumroad** — package the R630 GPU→Ollama build as a paid guide (passive income)
|
||
|
||
> Fiverr is optional 4th; skip it initially — Upwork + Reddit + Gumroad is the right
|
||
> concentration. Fiverr's race-to-the-bottom pricing fights the premium positioning.
|
||
|
||
---
|
||
|
||
## Rate research (comparable listings)
|
||
|
||
- Proxmox VE / homelab specialists on Upwork: **$40–$100/hr** (generalists $40–60, deep infra $75–100)
|
||
- GPU passthrough + local AI infra: **$75–$150/hr** (niche, high demand, low supply)
|
||
- Embedded/Android TV/ESP32: **$50–$100/hr**
|
||
- Gumroad tech guides: **$9–$49** one-time
|
||
|
||
**Recommended anchor: $75/hr** (freelance) + **$19 guide** (Gumroad). Anchor high — the
|
||
Maxwell/Vulkan and 100K-context wins are genuinely above-commodity. Don't list $20/hr;
|
||
it signals "will do anything" and attracts the worst clients.
|
||
|
||
---
|
||
|
||
## 1. Upwork profile (ready to paste)
|
||
|
||
**Title:**
|
||
> Self-Hosted AI & Homelab Infrastructure — GPU Passthrough, Ollama, Proxmox
|
||
|
||
**Overview:**
|
||
```
|
||
I get local AI running on hardware you own — instead of renting a cloud API.
|
||
|
||
I've built a 4-lane multi-GPU LLM architecture across an RTX 4080 SUPER, RTX 3070,
|
||
and a retired Dell R630 (Quadro M4000), with a single model standard and per-lane
|
||
latency/VRAM routing. Highlights I can reproduce for you:
|
||
|
||
• GPU passthrough + Ollama on Proxmox (incl. the CUDA→Vulkan migration when Ollama
|
||
dropped Maxwell support — a non-obvious fix most people burn hours on)
|
||
• 100K-token context on 16GB VRAM with zero CPU offload (Flash Attention + KV-cache quant)
|
||
• Multi-host Ollama routing: premium / batch / always-on lanes
|
||
• Homelab: Proxmox, Docker, ZFS (SLOG/L2ARC), backups (PBS), networking
|
||
• Hardware: Android TV rooting (Magisk/Amlogic), ESP32-S3 firmware, ADB automation
|
||
|
||
If you want a local LLM running on your GPU and it won't cooperate — I can fix it.
|
||
```
|
||
|
||
**Skills/tags:** Proxmox VE, GPU Passthrough, Ollama, LLM, Self-Hosted, Docker, Linux
|
||
System Administration, ZFS, Homelab, NVIDIA CUDA, Vulkan.
|
||
|
||
**Rate:** $75/hr.
|
||
|
||
**Portfolio items:** attach the 3 pieces in `portfolio/` (R630 GPU/Ollama, multi-GPU
|
||
routing, SK4 Pro rooting).
|
||
|
||
---
|
||
|
||
## 2. Reddit presence (reputation, not a storefront)
|
||
|
||
**Handle suggestion:** something credible and technical (e.g. `selfhosted-gpu-guy` or your
|
||
existing handle). Do NOT spam links — answer help threads, drop the portfolio link only
|
||
when it's genuinely relevant.
|
||
|
||
**Primary subs:**
|
||
- r/LocalLLaMA — where "Ollama won't use my GPU" lives
|
||
- r/homelab — Proxmox/GPU passthrough audience
|
||
- r/selfhosted — self-hosted AI
|
||
- r/ollama — direct model/GPU troubleshooting
|
||
|
||
**Approach:** Help first. Each answer = proof of expertise. Link the Gumroad guide or
|
||
Upwork profile only when someone explicitly wants it done-for-them.
|
||
|
||
---
|
||
|
||
## 3. Gumroad listing (paid guide)
|
||
|
||
**Title:** *Run Ollama on Your Own GPU: The R630 Passthrough & Multi-GPU Routing Guide*
|
||
|
||
**Pitch:**
|
||
> The exact steps to take a retired server (or any NVIDIA GPU) and turn it into a 24/7
|
||
> local LLM box — including the CUDA→Vulkan fallback fix, 100K-context-on-16GB config,
|
||
> and multi-host routing. Written from a real 3-GPU deployment, not theory.
|
||
|
||
**Price:** $19 (or $12 launch).
|
||
|
||
**Contents:**
|
||
1. Hardware + driver setup (incl. Maxwell/Vulkan gotcha)
|
||
2. Ollama as a systemd service (LAN-open, keep_alive, model pinning)
|
||
3. 100K ctx on 16GB VRAM (Flash Attention + KV-cache q4_0)
|
||
4. Multi-GPU lane routing architecture
|
||
5. Troubleshooting: `ollama ps`, nvidia-smi, cold-model timeouts
|
||
|
||
---
|
||
|
||
## Setup checklist (what's DONE vs what needs YOU)
|
||
|
||
### ✅ Done (files ready in this repo)
|
||
- [x] Positioning statement + bio (`positioning.md`)
|
||
- [x] 3 portfolio pieces (`portfolio/`)
|
||
- [x] Upwork/Fiverr profile copy (above)
|
||
- [x] Gumroad listing copy (above)
|
||
- [x] Outreach targets + drafted messages (`outreach.md`)
|
||
|
||
### 🔐 Requires your identity/verification (can't be automated — and I won't fake it)
|
||
- [ ] Upwork: gov ID verification, real phone, tax info (W-9/W-8), bank payout. **Needs you.**
|
||
- [ ] Gumroad/Ko-fi: email + payout method (bank/PayPal). **Needs you.**
|
||
- [ ] Reddit: your real account (or an aged account) — reputation can't be faked. **Needs you.**
|
||
|
||
### 🚦 Sequence
|
||
1. You create/verify the 3 accounts (I can't do ID verification).
|
||
2. Paste the profile copy above (it's done).
|
||
3. Attach the 3 portfolio pieces.
|
||
4. I hand you the outreach messages; you send from your accounts (fresh accounts + mass
|
||
DMs = ban risk, so it has to be human-paced from your real account).
|