LLM Event

LLM

This event is over. Follow my socials, or view my projects page to know when the next event is.

This event was a website where, over the course, of 3 days, anyone was able to send any requests to my self-hosted AI.

This experiment was done to see how many requests my GPU, an RTX 3080 Ti, could handle.

It was intended to last a week, and support around 100 requests per 3 hours.

It lasted 3 days, and supported 140k requests to the site, as well as over 5 million requests.

Detailed statistics are below.

        Requests: ~5.5 million
        Visits: 140k
        Endpoints: 2
        Tokens used: ~557 million
        Awards: 1
        Uptime: 100%

    

Try some of my other projects