Frengeebulk Shopify sync and three new markets
I work on the global ecommerce platform behind the world’s #1 powersports brand, more than $1B a year in transactions.
< 1 minfrom 15 minutes
The problem
Price and inventory for tens of thousands of products went to Shopify one update at a time. At volume, those messages flooded the RabbitMQ queues and dragged the whole system down. A heavily used core feature also took fifteen minutes to process its data.
Illustration, not to scale. Every product used to be its own message on the queue.
To scale, with the after bar drawn at its one-minute ceiling.
What I did
I designed and built a separate bulk sync service that sends price and inventory to Shopify in batches. I reworked the slow feature’s processing and its caching. I built features for three new international markets. Now I lead product qualification with LLMs, matching a heavy catalog into Shopify categories.
What changed
The queues stopped falling over. The fifteen-minute job runs in under a minute, about 93% faster. The platform launched in three new markets.
The numbers
- 3
- new markets
- $1B+
- a year through the platform
Stack
- TypeScript
- NestJS
- Node.js
- React
- PostgreSQL
- MongoDB
- RabbitMQ
- Redis
- GraphQL
- Shopify
- GCP
- Kubernetes
- ArgoCD
- Elasticsearch