Downloadable computer software using artificial intelligence (AI) for optimizing efficiency, GPU memory, and reducing latency of data inferencing and throughput; Downloadable software development tools for optimizing efficiency, GPU memory, and reducing latency of data inferencing and throughput; Downloadable application programming interface (API) software