Part of the Khronos Group
OpenGL.org

The Industry's Foundation for High Performance Graphics

from games to virtual reality, mobile phones to supercomputers

Results 1 to 6 of 6

Thread: Parallel loading of object files.

  1. #1
    Junior Member Newbie
    Join Date
    Dec 2011
    Posts
    16

    Parallel loading of object files.

    Ok, so I'm trying to load really huge object files using the Nate Robin's GLM drawModel() function and I was wondering if any of you know if there's an existent way for me to utilize numerous cores in loading the model instead of just one. I thought if not then I'd figure out a way to split the object file into numerous smaller ones, maybe write a small program that does so or something. Then I'd use multiple threads to load the files concurrently. Any thoughts, suggestions or preferably knowledge of existent methods that do the previous or something similar?

    Your help is much appreciated,
    -W

  2. #2
    Senior Member OpenGL Lord
    Join Date
    May 2009
    Posts
    5,939

    Re: Parallel loading of object files.

    In general, the primary cost of loading any large file is in loading the file. Which is a fundamentally single-threaded operation. Splitting it into multiple files will only make it take longer.

    If you want to make model loading take less time, then compress the file and decompress it after loading.

  3. #3
    Junior Member Regular Contributor
    Join Date
    Aug 2007
    Location
    Adelaide, South Australia
    Posts
    208

    Re: Parallel loading of object files.

    The best thing that you can do is put it in one big (compressed) file and then de-fragment your hard disk to minimise the seek time.
    The only time that splitting the file might improve load time is if you had more than one physical hard disk and put one file on each.

  4. #4
    Junior Member Newbie
    Join Date
    Dec 2011
    Posts
    16

    Re: Parallel loading of object files.

    Quote Originally Posted by Alfonse Reinheart
    In general, the primary cost of loading any large file is in loading the file. Which is a fundamentally single-threaded operation. Splitting it into multiple files will only make it take longer.

    If you want to make model loading take less time, then compress the file and decompress it after loading.
    Quote Originally Posted by Simon Arbon
    The best thing that you can do is put it in one big (compressed) file and then de-fragment your hard disk to minimise the seek time.
    The only time that splitting the file might improve load time is if you had more than one physical hard disk and put one file on each.
    I understand what you both mean. Thanks for the heads up.

    What I don't understand though is your talk about compressing the large obj file.

    @Alfonse:
    What do you mean by compress the file and then decompress it after loading? Please elaborate.

  5. #5

  6. #6
    Junior Member Newbie
    Join Date
    Dec 2011
    Posts
    16

    Re: Parallel loading of object files.

    Quote Originally Posted by Alfonse Reinheart
    Compression. Zip files. zlib. Do any of these things ring a bell?
    I understand the concepts but not how to use them in this specific situation. Excuse my ignorance, I'm fairly new at this. Thank you for your patience as well as your willingness to help so far.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •