Ray 2.59 Graduates Ray Data LLM and Ray Serve LLM to General Availability and Enables Token Authentication by Default for Local Clusters
Ray 2.59.0 declares its LLM batch and serving APIs generally available, upgrades to vLLM 0.27.0, and turns on token authentication for local clusters, with all clusters to follow in 2.61.