Fix: Use /data directory for Hugging Face Spaces persistent storage

HUGGINGFACE_DEBUG.md

@@ -0,0 +1,179 @@
+# Debugging Hugging Face Space Deployment
+
+## Current Status
+✅ Code successfully pushed to Hugging Face (commit: 265f878)
+⏳ Space shows "Running" status - waiting for build/deployment
+
+## Steps Completed
+1. ✅ Merged `clean-master` into `master` branch
+2. ✅ Pushed to GitHub (`origin/master`)
+3. ✅ Pushed to Hugging Face (`huggingface/master` and `huggingface/main`)
+
+## Debugging Steps
+
+### 1. Check Build Logs on Hugging Face
+1. Go to https://huggingface.co/spaces/MCP-1st-Birthday/Reuben_OS
+2. Click on the **"Files"** tab
+3. Look for **"Logs"** or **"Build"** section
+4. Check for any errors during build
+
+### 2. Common Issues & Solutions
+
+#### **Issue: Space stuck on "Running"**
+**Solution:**
+- Wait 2-3 minutes for initial build
+- Check if `Dockerfile` exists and is properly configured
+- Verify `next.config.mjs` has correct settings
+- Check if `package.json` dependencies can install
+
+#### **Issue: Build fails with module errors**
+**Solution:**
+- Check that all imports are correct
+- Verify no references to deleted files (SessionManager, etc.)
+- Run `npm install` and `npm run build` locally first
+
+#### **Issue: App loads but files don't appear**
+**Solution:**
+- The new passkey system requires user to:
+  1. Open File Manager
+  2. Click "Secure Data" in sidebar
+  3. Enter a passkey
+  4. Upload files
+- For public files:
+  1. Click "Public Files" in sidebar
+  2. Upload files directly
+
+### 3. Environment-Specific Issues
+
+#### **Data Directory Permissions**
+The app creates directories in `public/data/`:
+```
+public/
+└── data/
+    ├── public/          # Public files
+    └── {passkey}/       # Secure files per passkey
+```
+
+**Check on Hugging Face:**
+- Hugging Face Spaces may have read-only file system
+- Persistent storage requires special configuration
+- May need to use `/data` directory instead
+
+#### **Fix for Hugging Face Persistent Storage:**
+Update these routes to use Hugging Face's `/data` directory:
+
+**In `/app/api/data/route.ts`:**
+```typescript
+const DATA_DIR = process.env.SPACE_ID 
+  ? '/data' 
+  : path.join(process.cwd(), 'public', 'data')
+```
+
+**In `/app/api/files/route.ts`:**
+```typescript
+const DATA_DIR = process.env.SPACE_ID 
+  ? '/data' 
+  : path.join(process.cwd(), 'public', 'data')
+```
+
+**In `/app/api/public/route.ts`:**
+```typescript
+const DATA_DIR = process.env.SPACE_ID 
+  ? '/data' 
+  : path.join(process.cwd(), 'public', 'data')
+```
+
+### 4. Force Rebuild on Hugging Face
+
+If the space doesn't auto-rebuild:
+1. Go to space settings
+2. Click **"Factory Reboot"** to force a rebuild
+3. OR make a small commit:
+   ```bash
+   git commit --allow-empty -m "Trigger rebuild"
+   git push huggingface master:main
+   ```
+
+### 5. Check Space Configuration
+
+Verify your space has correct settings:
+- **SDK**: Docker or nodejs
+- **SDK version**: 18 (for Node.js)
+- **App port**: Should match your app (3000 for Next.js)
+
+### 6. Local Testing vs Production
+
+**Key Differences:**
+- **Local**: Uses `public/data` directory
+- **Hugging Face**: Should use `/data` directory for persistence
+- **Local**: Hot reload works
+- **Hugging Face**: Requires rebuild on each push
+
+### 7. Verify the Deployment
+
+Once the space loads:
+1. **Test Public Files:**
+   - Open File Manager
+   - Click "Public Files"
+   - Try uploading a file
+   - Verify it appears in the list
+
+2. **Test Secure Storage:**
+   - Click "Secure Data"
+   - Enter any passkey (e.g., "test123")
+   - Upload a file
+   - Lock and unlock with same passkey
+   - Files should persist
+
+### 8. Common Error Messages
+
+**"Module not found"**
+- Missing dependency in package.json
+- Run: `npm install <missing-package>`
+- Commit and push
+
+**"Build failed"**
+- Check Hugging Face build logs
+- Look for TypeScript errors
+- Verify all imports
+
+**"Cannot write to directory"**
+- File system is read-only
+- Need to use `/data` directory
+- Apply the fixes in Section 3
+
+### 9. Monitoring Build Progress
+
+Watch the space status:
+- **Building**: Code is being compiled
+- **Running**: App is starting
+- **Ready**: App is live and accessible
+- **Error**: Build failed - check logs
+
+### 10. Quick Checklist
+
+- [ ] Code pushed to Hugging Face
+- [ ] Space shows "Building" or "Running"
+- [ ] Wait 2-3 minutes for initial build
+- [ ] No errors in build logs
+- [ ] Space shows "Ready" status
+- [ ] Can access the URL
+- [ ] File Manager loads
+- [ ] Can upload to Public Files
+- [ ] Can create passkey and upload to Secure Data
+
+## Next Steps
+
+1. **Wait** for the current build to complete (2-3 minutes)
+2. **Check** the Hugging Face space URL
+3. **Review** build logs if there are errors
+4. **Apply** the `/data` directory fix if file uploads fail
+5. **Test** the file upload functionality
+
+## Getting Help
+
+If issues persist:
+1. Share the Hugging Face build logs
+2. Share any browser console errors
+3. Check if the space is "Ready" or still "Building"
+4. Verify the space settings are correct

app/api/data/route.ts

@@ -3,7 +3,10 @@ import fs from 'fs'
 import path from 'path'
 import { writeFile, mkdir, unlink, readdir, stat } from 'fs/promises'
 
-const DATA_DIR = path.join(process.cwd(), 'public', 'data')
+// Use /data for Hugging Face Spaces persistent storage, fallback to public/data for local dev
+const DATA_DIR = process.env.SPACE_ID
+    ? '/data'
+    : path.join(process.cwd(), 'public', 'data')
 
 // Ensure data directory exists
 if (!fs.existsSync(DATA_DIR)) {

app/api/documents/generate/route.ts

@@ -3,7 +3,10 @@ import { DocumentGenerator } from '@/lib/documentGenerators';
 import fs from 'fs';
 import path from 'path';
 
-const DATA_DIR = path.join(process.cwd(), 'public', 'data');
+// Use /data for Hugging Face Spaces persistent storage
+const DATA_DIR = process.env.SPACE_ID
+  ? '/data'
+  : path.join(process.cwd(), 'public', 'data');
 const PUBLIC_DIR = path.join(DATA_DIR, 'public');
 
 // Ensure directories exist

app/api/documents/process/route.ts

@@ -4,7 +4,10 @@ import ExcelJS from 'exceljs';
 import fs from 'fs';
 import path from 'path';
 
-const DATA_DIR = path.join(process.cwd(), 'public', 'data');
+// Use /data for Hugging Face Spaces persistent storage
+const DATA_DIR = process.env.SPACE_ID
+  ? '/data'
+  : path.join(process.cwd(), 'public', 'data');
 const PUBLIC_DIR = path.join(DATA_DIR, 'public');
 
 export async function POST(request: NextRequest) {

app/api/files/route.ts

@@ -2,8 +2,10 @@ import { NextRequest, NextResponse } from 'next/server'
 import fs from 'fs'
 import path from 'path'
 
-// Use /data for persistent storage
-const DATA_DIR = path.join(process.cwd(), 'public', 'data')
+// Use /data for Hugging Face Spaces persistent storage
+const DATA_DIR = process.env.SPACE_ID
+  ? '/data'
+  : path.join(process.cwd(), 'public', 'data')
 const PUBLIC_DIR = path.join(DATA_DIR, 'public')
 
 // Ensure directories exist

app/api/public/route.ts

@@ -2,7 +2,10 @@ import { NextRequest, NextResponse } from 'next/server'
 import fs from 'fs'
 import path from 'path'
 
-const DATA_DIR = path.join(process.cwd(), 'data')
+// Use /data for Hugging Face Spaces persistent storage
+const DATA_DIR = process.env.SPACE_ID
+  ? '/data'
+  : path.join(process.cwd(), 'public', 'data')
 const PUBLIC_DIR = path.join(DATA_DIR, 'public')
 
 // Ensure public directory exists

app/api/public/upload/route.ts

@@ -2,7 +2,10 @@ import { NextRequest, NextResponse } from 'next/server';
 import fs from 'fs';
 import path from 'path';
 
-const DATA_DIR = path.join(process.cwd(), 'public', 'data');
+// Use /data for Hugging Face Spaces persistent storage
+const DATA_DIR = process.env.SPACE_ID
+  ? '/data'
+  : path.join(process.cwd(), 'public', 'data');
 const PUBLIC_DIR = path.join(DATA_DIR, 'public');
 
 // Ensure directory exists