Message boards : Cafe Rosetta : internet requirements?
Author | Message |
---|---|
BKFC Send message Joined: 21 Apr 20 Posts: 34 Credit: 3,160,585 RAC: 0 |
I have several machines running variants of Linux (including an 8-core Ryzen-7 2700x) that I could devote at least partially to this project. That said, my hot spot internet service (not fiber optic) has two issues: (1) It's slow - now down to 1 Mbps or less due I think to neighbors now working from home and running Zoom conferences; (2) it's metered at a max of 100 GB/month. If this project entails transfers back and forth (both are metered) in the multi GB range, then I don't think it will work. If the projects are instead compute bound, then I have the cycles. I apologize if this issue was addressed elsewhere. |
William Albert Send message Joined: 22 Mar 20 Posts: 23 Credit: 1,069,070 RAC: 610 |
Based on what a machine I spot-checked is currently doing, most of the work units are less than a megabyte. Here's a quick file listing of the Rosetta directory: 485M database_357d5d93529_n_methyl.zip 68K Helvetica.txf 5.8M hgfp_split2_460_data.zip 348K LiberationSans-Regular.ttf 110M minirosetta_3.78_x86_64-pc-linux-gnu 270M minirosetta_database_d0bf94b.zip 47M minirosetta_graphics_3.78_x86_64-pc-linux-gnu 176K pass_build.bp_20200412145206_perturb_2790_0001_0001_fragments_data.zip 184K pass_build.bp_20200412145353_perturb_4974_0001_0001_fragments_data.zip 184K pass_build.bp_20200412145841_perturb_2744_0001_0001_fragments_data.zip 180K r3x_1541_data.zip 172K r3x_5760_data.zip 172K r3x_5901_data.zip 172K r4d_1164_data.zip 180K r4k_11075_data.zip 176K r4k_12609_data.zip 180K r4k_15519_data.zip 176K r4k_17413_data.zip 180K r4k_6123_data.zip 176K r4k_6474_data.zip 64K rb_04_19_21998_21765_ab_t000__h002_robetta.200.18mers.index.gz 88K rb_04_19_21998_21765_ab_t000__h002_robetta.200.3mers.index.gz 76K rb_04_19_21998_21765_ab_t000__h002_robetta.200.8mers.index.gz 4.0K rb_04_19_21998_21765_ab_t000__h002_robetta_FLAGS 4.0K rb_04_19_21998_21765_ab_t000__h002_robetta.zip 276K rb_04_19_22030_21740_ab_t000__robetta.200.3mers.index.gz 256K rb_04_19_22030_21740_ab_t000__robetta.200.6mers.index.gz 252K rb_04_19_22030_21740_ab_t000__robetta.200.7mers.index.gz 4.0K rb_04_19_22030_21740_ab_t000__robetta_FLAGS 28K rb_04_19_22030_21740_ab_t000__robetta.zip 76K rb_04_19_22040_21638_ab_t000__h001_robetta.200.10mers.index.gz 88K rb_04_19_22040_21638_ab_t000__h001_robetta.200.3mers.index.gz 84K rb_04_19_22040_21638_ab_t000__h001_robetta.200.5mers.index.gz 4.0K rb_04_19_22040_21638_ab_t000__h001_robetta_FLAGS 4.0K rb_04_19_22040_21638_ab_t000__h001_robetta.zip 232K rb_04_19_22059_21792_ab_t000__h002_robetta.200.3mers.index.gz 220K rb_04_19_22059_21792_ab_t000__h002_robetta.200.6mers.index.gz 216K rb_04_19_22059_21792_ab_t000__h002_robetta.200.7mers.index.gz 4.0K rb_04_19_22059_21792_ab_t000__h002_robetta_FLAGS 8.0K rb_04_19_22059_21792_ab_t000__h002_robetta.zip 120M rosetta_4.15_x86_64-pc-linux-gnu 118M rosetta_graphics_4.15_x86_64-pc-linux-gnu 1.2G total The larger files are application binaries and database files which are downloaded as needed, rather than with every work unit. Also, unlike most projects, Rosetta@home work units execute for a period of time that you specify, rather than for the amount of work required to "complete" the unit. As such, you can reduce bandwidth usage by increasing the runtime length in your profile preferences. Finally, the "Computing preferences" section of you account profile gives you an option to explicitly limit how much total data Rosetta will transfer within a given period of time (e.g., 30 days). If you hit that limit, it won't transfer any more data until the time period rolls over. So in short, you'll be fine. The project welcomes your cycles. :) |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1670 Credit: 17,493,791 RAC: 24,556 |
I have several machines running variants of Linux (including an 8-core Ryzen-7 2700x) that I could devote at least partially to this project. That said, my hot spot internet service (not fiber optic) has two issues: (1) It's slow - now down to 1 Mbps or less due I think to neighbors now working from home and running Zoom conferences; (2) it's metered at a max of 100 GB/month. If this project entails transfers back and forth (both are metered) in the multi GB range, then I don't think it will work. If the projects are instead compute bound, then I have the cycles.Some of the downloads are very large, but are then used by many Tasks. And the downloads for most of those Tasks are quite small (a few hundred kB). However uploads (returned results) can vary from several hundred KB to 30+ MB. Limiting the number of Tasks you run at a time, would limit the number of results produced, and so the amount of data sent back. Having said that, i've been running Rosetta for around 3 weeks now, all 6cores/12threads, and my network Data for BOINC (Rosetta being the only project on this computer) has been just under 11GB so far. Generally you want to have around 1.2GB of RAM (or more) per thread you plan to use (so for 8c/16t then 20GB bare minimum RAM to use all cores/threads and not run in to memory issues at some stage). Some Tasks require 1.5GB per Task, there are soon to be some that may need up to 4GB. And you need to allow BOINC to use at least 1GB of storage space per Task you plan to run. And a small cache is best (1 day or less). If you run more than one project, a very, very, very small cache is best (.4 days or less). In your Account, Computing preferences, these are good values to start with. "Setting Use at most 100% of the CPUs" will use less cores/threads if you don't have enough RAM to run all cores & threads without running in to Memory issues. Computing Usage limits Use at most 100% of the CPUs Use at most 100% of CPU time When to suspend Suspend when computer is on battery (not selected) Suspend when computer is in use (not selected) Suspend GPU computing when computer is in use (not selected) 'In use' means mouse/keyboard input in last 3 minutes Suspend when no mouse/keyboard input in last --- minutes Suspend when non-BOINC CPU usage is above --- % Compute only between --- Other Store at least 1 days of work Store up to an additional 0.02 days of work Switch between tasks every 60 minutes Request tasks to checkpoint at most every 60 seconds Disk Use no more than 20 GB Leave at least 2 GB free Use no more than 60 % of total Memory When computer is in use, use at most 95 % When computer is not in use, use at most 95 % Leave non-GPU tasks in memory while suspended (not selected) Page/swap file: use at most 75 % Grant Darwin NT |
BKFC Send message Joined: 21 Apr 20 Posts: 34 Credit: 3,160,585 RAC: 0 |
Thanks for those inputs. I've downloaded the app, but I'm pretty much stuck at that point. When I first launched the BOINC app and selected Rosetta@home, it promptly tried to retrieve a project and locked out all other input, including the options tab. I had to kill the processes and reboot to restore the system. The second time it stuck at "Retrieving current status.", again locking out any attempt at setting options (in fact I've never seen the options window content - it just pops up blank - if at all). From my location I have no way of knowing whether this is due to low bandwidth (now around 0.5 Mbps) or some other setup issue. |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1670 Credit: 17,493,791 RAC: 24,556 |
Thanks for those inputs. I've downloaded the app, but I'm pretty much stuck at that point. When I first launched the BOINC app and selected Rosetta@home, it promptly tried to retrieve a project and locked out all other input, including the options tab. I had to kill the processes and reboot to restore the system. The second time it stuck at "Retrieving current status.", again locking out any attempt at setting options (in fact I've never seen the options window content - it just pops up blank - if at all).It is best to set the option on the Web site. Click on your name at the top of this page, then under Preferences, When and how BOINC uses your computer, Computing preferences. Once you've made & saved the changes, the next time BOINC contacts the project it will get the new settings, or on the BOINC Manager (View, Advanced), just Select Rosetta in the Projects tab, and click on Update. On my systems, using the BOINC Manager, Computing preferences it can take over 5 seconds of "Communicating with BOINC client" before the Computing preferences come up. Grant Darwin NT |
Mod.Sense Volunteer moderator Send message Joined: 22 Aug 06 Posts: 4018 Credit: 0 RAC: 0 |
The website shows your machine has been assigned a number of work units. BOINC will have to complete the initial downloads of the larger application and database files before they can being processing. The website doesn't show if you are still downloading files. If you could be more specific about what series of steps you are taking that brings you to the locked state, that would be helpful. I see your machine is Linux, there are a number of ways to have installed BOINC on Linux. Did you follow a specific series of instructions when you installed BOINC? Rosetta Moderator: Mod.Sense |
Message boards :
Cafe Rosetta :
internet requirements?
©2024 University of Washington
https://www.bakerlab.org