Web crawler Dashboard with Next.js & Go Backend

Screenshot of the application interface

Features

• ** Modern Stack**: Next.js 15, React 19, TypeScript, Tailwind CSS
• ** Backend**: Gin (Go) with MySQL, WebSockets
• ** Data Tools**: TanStack Query + Tables for efficient data handling
• ** UI Components**: Responsive layout, Recharts, Framer Motion animations
• ** Form Handling**: React Hook Form with validation
• ** Notifications**: React Hot Toast system

Tech Stack

Frontend	Backend
Next.js 15	Go 1.21+
React 19	Gin Framework
TypeScript	GORM (ORM)
Tailwind CSS	MySQL
TanStack Query/Table	WebSockets
Recharts	Hybrid Architecture

Getting Started

Prerequisites

• Node.js 18+
• Go 1.21+
• MySQL 8.0+

Installation

1. Clone the repository:

   git clone https://github.com/Timjini/web_crawler.git
   cd web_crawler
   

Setup Instructions

Frontend Setup

cd client
npm install
cp .env.example .env.local
npm run dev

### Backend setup
cd back-end
go mod download
go mod tidy "when facing an issue"
make run

#### run migrations 
dbmate up 
dbmate down 

dbmate drop

## Database Configuration

### Production Database Setup
```env
# Remote MySQL Database Connection
DATABASE_URL=mysql://users:pass@localhost:3306/db_name?parseTime=true