Summary
The Big Data Analysis Platform (BDAP) at UofL is a GPU-accelerated HPC cluster designed for distributed parallel computing and data processing. BDAP supports data-intensive research, simulation and analytics with large-memory servers, ample local storage and a mix of CPUs and GPUs for a variety of scientific and engineering workflows.
Body
Before You Begin
Ensure you have a valid UofL login credentials.
Review the Research Computing System Use Policies for compliance and security requirements.
Request access through the Research Computing group if you are a new user.
Instructions
Request Access to Big Data
Submit a service request ticket to the Research Computing group with a brief description of your research activity and resource needs (CPU, memory, GPU, duration).
Log In to Big Data
Use your UofL credentials to log in to BDAP’s login nodes. Account sharing is prohibited; each user must use their own credentials.
Prepare and Submit Jobs
- Place input/output files in your scratch directory. This directory is not backed up and files not accessed in 30 days may be deleted.
- Use your home directory for code and small datasets (quota: 50 GB, backed up).
- Submit jobs using the Slurm workload manager. Request only the resources needed for your job to ensure fair system use.
- Avoid running computational jobs on login nodes.
Monitor and Manage Jobs
- Each user is limited to a specific number of queued and active jobs.
- Jobs have a maximum allowed run-time; use checkpointing/restart features if available.
- Idle jobs or jobs not using allocated GPUs will be terminated after a 1-hour grace period.
Request Exceptions or Additional Resources
For longer job durations, more nodes, or access to large-memory or GPU nodes, submit a service request ticket with your requirements and justification.
Review System Documentation and Policies
Consult system documentation for job limits, resource allocation, and best practices.
Follow all acceptable use policies; prohibited activities include account sharing, cryptocurrency mining, and use of malicious software.
Further Readings
Need Additional Help
• Submit a Ticket: Use the self-service portal to log requests.