|
I'm a passionate Applied Mathematics & Computer Science student at NJIT with a focus on AI/ML and data science. Currently conducting research on Beyond Next-Token Prediction paradigms for Large Language Models, while leading impactful community organizations. current_focus:
- Novel LLM architectures (intent-inference over next-token prediction)
- Advanced transformer architectures & Graph-RAG systems
- Model Context Protocol (MCP) implementation
collaboration:
- AI/ML projects
- Hackathons & competitions
- Community tech initiatives
achievements:
- Raised $70K for student organization
- Led 100+ students to national conferences
- 2x increase in student internship placements |
|
🍎 Apple - AIML Product Engineering Intern (Summer 2025)
Impact: Led cutting-edge AI/ML product development for Apple Pay
+ Led team of 3 interns building MVP for Agentic Payment flow
+ Prototyped LLM-based product recommendation workflows with Apple Pay integration
+ Implemented Model Context Protocol (MCP) for merchant catalog parsing (TypeScript)
+ Designed Graph-RAG architecture for partner-facing ChatBotTech Stack: TypeScript LLM APIs MCP Graph-RAG Vector Databases
🚜 Caterpillar Inc. - Software Engineering Intern (Summer 2024)
Impact: Optimized SDLC using AI-powered analytics and automation
+ Analyzed software development efficiency using Generative AI
+ Built data visualization dashboards for quality metrics tracking
+ Improved team productivity through Agile & DevOps best practices
+ Automated code commit assessment and sprint velocity trackingTech Stack: Python Generative AI Agile DevOps Data Visualization
| Project | Description | Tech Stack | Highlights |
|---|---|---|---|
| 🧠 subliminal-research | Subliminal Learning: Replication & Mechanism Probes | PyTorch torch.func NumPy SciPy |
Reproduces noise-only trait transfer (0.222 same-init vs 0.122 cross-init); 3 pre-registered hypotheses, 25-seed CIs |
| 📜 scholastic-llm | LoRA Fine-Tune for Scholastic Argumentation | MLX Qwen 2.5 7B LoRA DPO Claude API |
4 adapters published on Hugging Face; best checkpoint 68/120 strict; DPO logged as a clean negative result |
| ⚙️ augustine | Local AI Agent Daemon with a Frozen Wire Protocol | Python 3.13 Starlette WebSocket SQLite |
JSON-RPC 2.0 contract never changed across the build; 3 model backends, zero vendor SDKs |
| 📐 first-principles-to-llms | Set Theory → Transformers → RLHF, Fully Derived | LaTeX PyTorch MLX Jupyter |
34 chapters in 3 auto-synchronized forms; definition → theorem → proof → code throughout |
|
What it does: A controlled testbed for subliminal learning — the claim that a student distilled on a teacher's outputs over semantically unrelated data still inherits the teacher's trait. Reproduces the effect on MNIST, then probes the mechanism. Verified baseline (M = 25 seeds):
Three pre-registered hypotheses:
The honest headline:
Predictions committed to |
# Distillation on noise, not MNIST
out = student(bx)[:, :, idx] # [M,B,L]
with t.no_grad():
tgt = teacher(bx)[:, :, idx] * teacher_temp
if mode == "soft":
loss = F.kl_div(
F.log_softmax(out, -1),
F.softmax(tgt, -1),
reduction="batchmean",
)
# bx is random noise — the student never
# sees a single real digit.Shared architecture: mlp: [784, 256, 256, 13]
logits: 10 real + 3 ghost
seeds: 25 (for CIs)
device: mps -> cuda -> cpu📄 Ships |
|
Evaluation (own rubric):
The negative result: finding: >
DPO gave no improvement over SFT
due to preference saturation —
chosen and rejected samples came
from the same model family.
status: reported, not hidden |
What it does: Fine-tunes Qwen 2.5 7B-Instruct with LoRA (via MLX on Apple Silicon) to answer philosophy and theology questions in a scholastic, Latin-inflected register with citations — a study in register transfer, not a doctrinal authority. The pipeline: What shipped:
Status: Complete through Phase 2 (scaled SFT + DPO experiment). |
|
What it does: A from-scratch agent harness. A local daemon runs the full context → model → stream → tools loop and exposes it over a versioned JSON-RPC 2.0 / WebSocket contract; the terminal UI and browser UI are just two clients of that same protocol. Design decisions worth defending:
Quality gates: Status: self-labeled v0.1 — shipped. A working prototype with an architecture designed to be extended, not a maintained product. |
# The agent turn loop, capped at 8 iters
async def run_agent_turn(
adapter, registry, messages, emit, *,
selector=None,
):
tools = registry.specs() if registry else None
if selector and tools:
messages, tools = await _apply_skill_selection(
selector, messages, tools
)
for _ in range(_MAX_TOOL_ITERS): # = 8
async for ev in adapter.stream(messages, tools):
if isinstance(ev, TextChunk):
await emit(TokenEvent(text=ev.text))
elif isinstance(ev, ToolCallRequest):
tool_calls.append(ev)
if not tool_calls:
await emit(DoneEvent(reason="complete"))
return |
% Every chapter, same contract:
\begin{definition} ... \end{definition}
\begin{theorem} ... \end{theorem}
\begin{proof} ... \end{proof}
% ...then runnable code.The 9 blocks: 01. Foundations # sets, proofs
02. Probability & Info
03. Stochastic Optimization
04. Neural Networks
05. Attention & Transformers
06. Pre-training
07. Post-training # SFT, RLHF, DPO
08. RL # MDPs -> GRPO
09. Inference & Serving |
What it does: A 34-chapter derivation chain that starts at set theory and does not stop until it reaches KV caching and speculative decoding. Every claim is derived, not described. What makes it unusual:
Companion repo:
|
mindmap
root((Pablo's<br/>Tech Stack))
Languages
Python ⭐⭐⭐⭐⭐
JavaScript/TypeScript ⭐⭐⭐⭐⭐
Java ⭐⭐⭐⭐
C++ ⭐⭐⭐⭐
SQL ⭐⭐⭐⭐
AI/ML
PyTorch
TensorFlow
Transformers
LangChain
RAG Systems
Vector DBs
Full Stack
React/Next.js
Node.js
REST APIs
GraphQL
WebSockets
Cloud & DevOps
AWS
Google Cloud
Azure
Docker
Kubernetes
CI/CD
|
Python |
JavaScript |
TypeScript |
Java |
C++ |
R |
LaTeX |
|
PyTorch |
TensorFlow |
Scikit-learn |
Pandas |
NumPy |
Matplotlib |
LangChain |
|
React |
Next.js |
Node.js |
Express |
Flask |
FastAPI |
Tailwind |
|
AWS |
GCP |
Azure |
Docker |
Kubernetes |
GitHub Actions |
Git |
|
PostgreSQL |
MongoDB |
Redis |
Supabase |
Firebase |
Prisma |
GraphQL |
|
Society of Hispanic Professional Engineers team_size: 20+ officers
member_base: 300+ students
funding_raised: $70,000+
conference_attendees: 100+ studentsKey Achievements:
Technologies Used:
|
Association of Latino Professionals For America status: First ALPFA chapter at NJIT
focus: Non-engineering Latino professionals
partnerships: 5+ local ALPFA chaptersKey Achievements:
Impact: Expanded professional opportunities beyond engineering, creating an inclusive community for all Latino students. |
"Empowering communities through technology, creating opportunities through collaboration, and building bridges between academia and industry."
graph LR
A[🔬 Research] --> B[Beyond Next-Token Prediction]
A --> C[Intent-Inference Models]
D[🤖 AI/ML] --> E[Transformer Architectures]
D --> F[Graph-RAG Systems]
D --> G[Agentic AI]
H[🌐 Community] --> I[SHPE Leadership]
H --> J[Student Mentorship]
H --> K[Tech Initiatives]
L[📚 Learning] --> M[Advanced MLOps]
L --> N[Graph Neural Networks]
L --> O[Quantum Computing]
style A fill:#ff6b6b
style D fill:#4ecdc4
style H fill:#ffe66d
style L fill:#a8e6cf
|
Beyond Next-Token Prediction Currently exploring novel paradigms for Large Language Models that reframe training from simple next-token prediction toward intent-inference and reasoning capabilities. Key Areas:
|
Building the Future of AI
|
|
Professional Networking |
View My Work |
Send a Message |
interests:
- AI/ML Research Collaborations
- Open Source Contributions
- Hackathons & Competitions
- Speaking Engagements
- Mentorship Opportunities
availability:
status: "Open to interesting projects!"
best_for: "AI/ML, Full-Stack, Research"
response_time: "Usually within 24 hours"⭐️ From pleyva2004 | Built with ❤️ and lots of ☕

