Before You Begin
Ensure you have a valid UofL user account and login credentials.
Review the Research Computing System Use Policies for compliance and security requirements.
Request access through the Research Computing group if you are a new user.
Objective or Task
Learn how to access, request accounts for and use the Big Data Analysis Platform for high-performance data analysis and research computing at UofL.
Instructions
Request Access to Big Data
Submit a service request ticket to the Research Computing group with a brief description of your research activity and resource needs (CPU, memory, GPU, duration).
Log In to Big Data
Use your UofL credentials to log in to BDAP’s login nodes. Account sharing is prohibited; each user must use their own credentials.
Prepare and Submit Jobs
- Place input/output files in your scratch directory. This directory is not backed up and files not accessed in 30 days may be deleted.
- Use your home directory for code and small datasets (quota: 50 GB, backed up).
- Submit jobs using the Slurm workload manager. Request only the resources needed for your job to ensure fair system use.
- Avoid running computational jobs on login nodes.
Monitor and Manage Jobs
- Each user is limited to a specific number of queued and active jobs.
- Jobs have a maximum allowed run-time; use checkpointing/restart features if available.
- Idle jobs or jobs not using allocated GPUs will be terminated after a 1-hour grace period.
Request Exceptions or Additional Resources
For longer job durations, more nodes, or access to large-memory or GPU nodes, submit a service request ticket with your requirements and justification.
Review System Documentation and Policies
Consult system documentation for job limits, resource allocation, and best practices.
Follow all acceptable use policies; prohibited activities include account sharing, cryptocurrency mining, and use of malicious software.
Outcome
After completing these steps, you will be able to access BDAP, submit and manage jobs, and use UofL’s Big Data resources for your research projects in compliance with university policies.
Further Readings
Need Additional Help
• Contact the ITS HelpDesk: Call 502-852-7997 during business hours:
o Monday through Thursday: 6:00am – 10:00pm
o Friday: 6:00am – 5:00pm
o Saturday: 7:00am – 5:00pm
o Sunday: 10:00am – 10:00pm
o University Holidays: 7:00am – 5:00pm
o Closed on Thanksgiving, the day after Thanksgiving, and Christmas.
o If you have an emergency during off hours, call the HelpDesk to be transferred to an on-call technician, or leave your request on voicemail. Your call will be returned the next day starting at 7am unless you specify a time.
• Live Chat: Chat with the ITS HelpDesk at https://apps.louisville.edu/it/livechat/phplive.php during business hours.
• Submit a Ticket: Use the self-service portal at http://service.louisville.edu to log requests or check the status of existing tickets.
• In-Person Support: Visit the iTechConnect 1:1 help located on the lower level of the Miller Information Technology Center, Belknap Campus, during business hours.