Luckily, that 558.5kB file only gets accessed once (unless there's a change in domain or SSL encryption). Once these files are initially downloaded, it's up to the client to retrieve them from the cache.
Following @Felix Kling's advice, fetching these files from a CDN can potentially eliminate the need for a second download since they may already be stored from another website. This is worth considering when deciding whether to bundle bootstrap css with your own custom css file. It could be more efficient to have bootstrap come from the CDN (or local cache) and load your custom content afterwards.
The time it takes to fetch these files shouldn't be a major issue, as modern browsers are capable of quickly retrieving multiple files. However, the challenge lies in loading all this data into memory, which is where performance can be impacted. For example, you need to load jquery before being able to call it, causing delays for any on-page scripts waiting for jquery to finish loading.