Snapshot: full project state
This commit is contained in:
116
platforms.md
Normal file
116
platforms.md
Normal file
@@ -0,0 +1,116 @@
|
||||
# Platform Setup — Profiles, Rates, Checklist
|
||||
|
||||
## Target platforms (3, not spread thin)
|
||||
|
||||
1. **Upwork** — highest-intent freelance gigs (Proxmox/AI infra buyers actively hire here)
|
||||
2. **Reddit** — reputation + inbound (r/homelab, r/selfhosted, r/LocalLLaMA, r/ollama)
|
||||
3. **Gumroad** — package the R630 GPU→Ollama build as a paid guide (passive income)
|
||||
|
||||
> Fiverr is optional 4th; skip it initially — Upwork + Reddit + Gumroad is the right
|
||||
> concentration. Fiverr's race-to-the-bottom pricing fights the premium positioning.
|
||||
|
||||
---
|
||||
|
||||
## Rate research (comparable listings)
|
||||
|
||||
- Proxmox VE / homelab specialists on Upwork: **$40–$100/hr** (generalists $40–60, deep infra $75–100)
|
||||
- GPU passthrough + local AI infra: **$75–$150/hr** (niche, high demand, low supply)
|
||||
- Embedded/Android TV/ESP32: **$50–$100/hr**
|
||||
- Gumroad tech guides: **$9–$49** one-time
|
||||
|
||||
**Recommended anchor: $75/hr** (freelance) + **$19 guide** (Gumroad). Anchor high — the
|
||||
Maxwell/Vulkan and 100K-context wins are genuinely above-commodity. Don't list $20/hr;
|
||||
it signals "will do anything" and attracts the worst clients.
|
||||
|
||||
---
|
||||
|
||||
## 1. Upwork profile (ready to paste)
|
||||
|
||||
**Title:**
|
||||
> Self-Hosted AI & Homelab Infrastructure — GPU Passthrough, Ollama, Proxmox
|
||||
|
||||
**Overview:**
|
||||
```
|
||||
I get local AI running on hardware you own — instead of renting a cloud API.
|
||||
|
||||
I've built a 4-lane multi-GPU LLM architecture across an RTX 4080 SUPER, RTX 3070,
|
||||
and a retired Dell R630 (Quadro M4000), with a single model standard and per-lane
|
||||
latency/VRAM routing. Highlights I can reproduce for you:
|
||||
|
||||
• GPU passthrough + Ollama on Proxmox (incl. the CUDA→Vulkan migration when Ollama
|
||||
dropped Maxwell support — a non-obvious fix most people burn hours on)
|
||||
• 100K-token context on 16GB VRAM with zero CPU offload (Flash Attention + KV-cache quant)
|
||||
• Multi-host Ollama routing: premium / batch / always-on lanes
|
||||
• Homelab: Proxmox, Docker, ZFS (SLOG/L2ARC), backups (PBS), networking
|
||||
• Hardware: Android TV rooting (Magisk/Amlogic), ESP32-S3 firmware, ADB automation
|
||||
|
||||
If you want a local LLM running on your GPU and it won't cooperate — I can fix it.
|
||||
```
|
||||
|
||||
**Skills/tags:** Proxmox VE, GPU Passthrough, Ollama, LLM, Self-Hosted, Docker, Linux
|
||||
System Administration, ZFS, Homelab, NVIDIA CUDA, Vulkan.
|
||||
|
||||
**Rate:** $75/hr.
|
||||
|
||||
**Portfolio items:** attach the 3 pieces in `portfolio/` (R630 GPU/Ollama, multi-GPU
|
||||
routing, SK4 Pro rooting).
|
||||
|
||||
---
|
||||
|
||||
## 2. Reddit presence (reputation, not a storefront)
|
||||
|
||||
**Handle suggestion:** something credible and technical (e.g. `selfhosted-gpu-guy` or your
|
||||
existing handle). Do NOT spam links — answer help threads, drop the portfolio link only
|
||||
when it's genuinely relevant.
|
||||
|
||||
**Primary subs:**
|
||||
- r/LocalLLaMA — where "Ollama won't use my GPU" lives
|
||||
- r/homelab — Proxmox/GPU passthrough audience
|
||||
- r/selfhosted — self-hosted AI
|
||||
- r/ollama — direct model/GPU troubleshooting
|
||||
|
||||
**Approach:** Help first. Each answer = proof of expertise. Link the Gumroad guide or
|
||||
Upwork profile only when someone explicitly wants it done-for-them.
|
||||
|
||||
---
|
||||
|
||||
## 3. Gumroad listing (paid guide)
|
||||
|
||||
**Title:** *Run Ollama on Your Own GPU: The R630 Passthrough & Multi-GPU Routing Guide*
|
||||
|
||||
**Pitch:**
|
||||
> The exact steps to take a retired server (or any NVIDIA GPU) and turn it into a 24/7
|
||||
> local LLM box — including the CUDA→Vulkan fallback fix, 100K-context-on-16GB config,
|
||||
> and multi-host routing. Written from a real 3-GPU deployment, not theory.
|
||||
|
||||
**Price:** $19 (or $12 launch).
|
||||
|
||||
**Contents:**
|
||||
1. Hardware + driver setup (incl. Maxwell/Vulkan gotcha)
|
||||
2. Ollama as a systemd service (LAN-open, keep_alive, model pinning)
|
||||
3. 100K ctx on 16GB VRAM (Flash Attention + KV-cache q4_0)
|
||||
4. Multi-GPU lane routing architecture
|
||||
5. Troubleshooting: `ollama ps`, nvidia-smi, cold-model timeouts
|
||||
|
||||
---
|
||||
|
||||
## Setup checklist (what's DONE vs what needs YOU)
|
||||
|
||||
### ✅ Done (files ready in this repo)
|
||||
- [x] Positioning statement + bio (`positioning.md`)
|
||||
- [x] 3 portfolio pieces (`portfolio/`)
|
||||
- [x] Upwork/Fiverr profile copy (above)
|
||||
- [x] Gumroad listing copy (above)
|
||||
- [x] Outreach targets + drafted messages (`outreach.md`)
|
||||
|
||||
### 🔐 Requires your identity/verification (can't be automated — and I won't fake it)
|
||||
- [ ] Upwork: gov ID verification, real phone, tax info (W-9/W-8), bank payout. **Needs you.**
|
||||
- [ ] Gumroad/Ko-fi: email + payout method (bank/PayPal). **Needs you.**
|
||||
- [ ] Reddit: your real account (or an aged account) — reputation can't be faked. **Needs you.**
|
||||
|
||||
### 🚦 Sequence
|
||||
1. You create/verify the 3 accounts (I can't do ID verification).
|
||||
2. Paste the profile copy above (it's done).
|
||||
3. Attach the 3 portfolio pieces.
|
||||
4. I hand you the outreach messages; you send from your accounts (fresh accounts + mass
|
||||
DMs = ban risk, so it has to be human-paced from your real account).
|
||||
Reference in New Issue
Block a user