Wednesday 06/25/14

9:30 am – 5:00 pm, 9:00 pm – 12:15 am

PH project

  • replotting all histograms — no more collecting all the big stuff into the last bin, this was confusing.
  • made new figure-producing figs (actually just histograms, the images are separate code still).
  • sent updated histograms (8 total) to Ajaz, along with some comments on the fig 2 layout and captions (can we please include more labels on the figures!)

project 2, team meeting

  • My tasks for next week:
    • cluster analysis for formamide titration data
    • cluster analysis of E4 data

Chromatin simulations

  • test polymer simulations with greater spacing (10 nm between molecules)
  • it looks like these all relax to 1, nI thought the nodes were supposed to be 10nm.
  • This is probably another good question for the authors if they ever write back.

Hacking an attractive force.

  • lets just build a quadratic or quartic well
  • outside the well we have the energy as 1 kT here. I have since changed it to zero.
  • This finally appears to be working with the code that Bogdan started ( see image below).
    • there’s this weird dip at the beginning, which could be due to the added stiffness of my polymer, it takes a while before the nodes can start interacting, but I’m not sure that’s it. Should probably investigate this more.
    • But for molecules of length 100+ we are closer to the expected 1/3rd scaling exponent.
  • My hacked version of a free polymer using openmmlib seems to ignore my force though. Maybe its a distance issue. Still has a 0.6 free polymer type scaling.

QuadraticLocalAttraction

OpenMM_DensePolymerMoreCorrect

Posted in Summaries | Comments Off on Wednesday 06/25/14

Welcome to my lab notebook

Welcome to my lab notebook. This is not a blog, which is written primarily to communicate information to other people, it is a lab notebook, which is written for me to make notes about the work I do in lab.

Why a wordpress site?

This notebook is built using the popular web software WordPress. This has built in a few properties that are very convenient in a lab notebook:

  1. Text searchable.
  2. Intelligent browsing.
    • Re-organize by date, Project category, or tag.
    • See those nifty calendars, categories, and word-clouds on the right.
  3. Cross-reference hyperlinks.
    • links to protocols, previous days work, git commits, scientific papers etc
  4. Digital cut and paste
    • Easier to add gel photos, microscopy images, simulation results with screen capture rather than real print.
  5. Backed up copies, accessible from anywhere.
    • If the lab burns down at least my notebook will be untouched.

Why (mostly) Open?

I believe lot of science never makes it past the notebook — at least that’s certainly true in my own work. Interesting observations that I never had the time to follow up properly; experiments and results that never made enough sense or amounted to a complete story; projects that got dropped because a different project was more exciting to me. Not to mention tons of data and experiments closely related to my published work that didn’t win a place in the main text or supplemental material that we published, or the real chronology in which we did those experiments.
Some of this stuff may still be useful though to a broader community. Whether you’re wondering what mid-stage development Drosophila embryos look in the absences of the SCM protein or perhaps could use some notes on setting up Windows Server 2012 as a lab server or were working out the crosses to make E(spl), sim double mutants — it might save you time to find notes of how other scientists have worked out these things. Maybe you have a faster set of crosses or a different SCM knockout phenotype — please leave a comment.
Finally large sections of the notebook are not open but are instead protected by passwords or kept completely private. These largely involve data that is relevant to my collaborative projects. Several of my own findings are also protected — such as hits from a gene-knockout screen that involved for me a lot of tedious screening, where that little list of hits would allow competitor groups to catch up on years of work in a few days experimenting on just that list.

Some bells and whistles

Protocol Management: All my protocols are version managed through Github. (See my protocols page). References to protocols within daily research entries I link to the version of the protocol as it stood on that day. The protocols page links to whatever the most recent version of the protocol is. And through github I can easily pull up diff files to compare what changed in a protocol between when I ran it five months ago and today.

Inspiration

Much of my inspiration for an Open, electronic lab notebook comes from my brother, Carl Boettiger. His philosophy and approach to Open Notebooks are elegantly described in his own Notebook.

Posted on by admin | Comments Off on Welcome to my lab notebook

Tuesday 06/24/14

10:00 am – 12:45 am

More simulation troubleshooting

Experimenting with weaker attractive forces

    energy = ("index*epsilon * .000000001 * (step(r-rm)*(r-rm)^4 * (1- step(r-2*rm))+ (rm)^4*step(r-2*rm));"
              "index=index1*index2")

reasonable scaling
WeaklyAttractingSticky7

10 fold stronger bonding: “sticky8” simulation

    energy = ("index*epsilon * .00000001 * (step(r-rm)*(r-rm)^4 * (1- step(r-2*rm))+ (rm)^4*step(r-2*rm));"
              "index=index1*index2")

TenFoldWeakerSticky8

not very substantial change in structure

further 10 fold reduction

  • sticky 9
    energy = (“indexepsilon * .0000001 * (step(r-rm)(r-rm)^4 * (1- step(r-2rm))+ (rm)^4step(r-2rm));”
    “index=index1
    index2″)
    Despite the fact the scaling is only slightly below the SAW polymer, the system is not fully self avoiding.
    The closest two monomers at any point throughout the simulation gets closer and closer as N increases, rapidly falling below the 10 nm exclusion.
    ViolatingExclusion

redoing simulations with no attractive forces

  • let’s check the self avoiding condition again.
  • hmmm… This actually looks very similar.
  • and I thought this scaling came out to .60 last night but doesn’t seem to.
    randomPolymerMoleculeOverlap

randomPolymerScaling

More issues

Now I can’t repeat Sticky6 (~flat scaling), final simulation to complete last night, in which I added a weakened attractive force back in after believing I had gotten the random walk polymer to scale properly at 0.6.

Sticky6_fullAttractionForce

Mirny lab code

  • Bashed away a bit at scaffoldExample to get it to run:
  • This is very slow. But globule 128 is 128,000 monomers, so that’s probably why.

scaffoldExampleRunning

Trying to shorten simulation time by reducing data size. Wrote script to load and truncate

Finally got this working

  • wrote a matlab wrapper to initialize the simulations using my RandomWalkPolymer function and to change key parameters like number of nodes and simulation time (see GitScripts)
  • simulations seem to be behaving well:

MirnyPolymerScaling

Questions on polymerutils

  • what are the inputs exampleOpenmm(sys.argv[1], sys.argv[2], int(sys.argv[3])) the example has 200 1 1 but doesn’t explain what these numbers mean.
  • Can someone explain the shape of the Grossberg and LG ‘repulsive’ potentials? Why is there a minimum near the contact radius that goes up and saturates afterwards.
Posted in Summaries | Comments Off on Tuesday 06/24/14

Monday 06/23/14

10:00 am – 5:00 pm, 10:00 pm – 12:30 am

Lab stuff

  • Finally found and installed drivers for Cajal’s AMD Radeon 6900 graphics card (this card is still driving the monitors).
  • installed new NVIDIA Quadro K4000 for GPU computing (still need to install the CUDA SDK etc)
  • moved RAM from Tuck to Cajal. Tuck failed to boot (maybe just extremely slow, should give it an hour or so to attempt to sort itself out after windows updates, it doesn’t like these and they process very slowly).

Chromatin

Simulations

  • clear exclusion issues revealed by sticky polymer sim. All polymers fit into the same volume. The expected volume of 500 monomers is 10E6, whereas the volume of the polymer (at all stages basically) is 10E4. Clearly an issue. (As is the negative scaling coefficient, since more monomers squeeze towards the center inside the volume. This is only expected in packing chains in tightly confined spaces).
  • attractive and repulsive energies built off of chain_a, which is the centroid-to-centroid distance between monomers, not the hard-sphere radius distance. This is probably a problem.
  • now running short sticky polymer simulations with simple change of radius for chain spacing in the energy functions.
  • Also exploring the alternative Grossberg energy functions used in the Minry polymer tools (in principle I should be able to import and call these rather than copy them since they are there own classes. Though figuring out the variable space is tricky since there’s essentially no documentation of it).
  • at first glance from the simulations this does not seem to have solved the problem.

StericExclusionFails

More issues

  • ‘GrossbergRepulsion’ energy function from Mirny lab openMM polymer doesn’t make sense to me as a repulsive energy. Why is this non-zero beyond the radius of the monomer?
    GrossbergRepulsiveForce

Discussions with Bogdan

  • Troubleshooting non-self avoiding behavior and wierd potentionals
  • believe repulsive force was targeted at all but the attractive nodes. Removed 1-index1*index2 part of repulsive force in polymer simulations (see GitScripts for code log)
  • Reducing potential energy magnitudes to minimize explosive behavior of polymer chains.

STORM

  • imaging sample D07. Not looking very strong staining, especially for a 150 kb region. Something has probably gone wrong.
Posted in Summaries | Comments Off on Monday 06/23/14

Protected: ANT-C PH clusters

This content is password protected. To view it please enter your password below:

Posted in Summaries | Comments Off on Protected: ANT-C PH clusters

Sunday 06/22/14

10:20 am – 11:15 pm

New simulations

  • sticky polymer simulations. same as blue simulations but reduce binding energy 10 fold. index*epsilon * .0001 * (step(r-rm)*(r-rm)^4 * (1- step(r-2*rm))+ (rm)^4*step(r-2*rm));
  • now running with 10 polymers, log scaled from 10 to 500 nodes, 3 rpts. Hopefully this will finish before tonight so I can look at it and set up a new batch of simulations.

STORM observations.

  • Black domains labeling pretty sparse I think — for an 80 kb region this are pretty dim.
  • background is pretty low, probably worth tripling the concentration and seeing if that helps, maybe I’ll try this tonight.
  • imaging D06. These regions are WAY larger than D05. Maybe something happened in the genome here. (or the D05 stain failed more spectacularly than I thought, will have to look at the real counts).

PH project

  • Analyzing S2 PH data
  • sent draft of S2 PH data ANTC data to Ajaz
Posted in Summaries | Comments Off on Sunday 06/22/14

Saturday 06/21/14

9:30 am – 5:45 pm

Simulations

To Analyze

  • OpenMM free Polymer sims
  • Odyssey Matlab periodic bonds

OpenMM free Polymers

Only a single run, but not quite the right scaling — expect 0.60. And a y-intercept at 0. See previous simulations results using my monte carlo simulator in Matlab

FreePolymerOpenMMscaling

This is still growing substantially faster than closest packing.

Running new simulations with more repeats (4) and smaller polymers (only up to 500 — the large ones really take forever).

Matlab Periodically bound polymers

Not enough simulation time for binding nodes to find each other. Some succeed, some do not.

NotConnected

MostlyConnected

Future development

  • wrote to RC computing about installing OpenMM and openMM-polymer on Odyssey.

STORM

  • imaging D04
  • sample not too bright. Hopefully still enough localizations to map out the basic structure.
Posted in Summaries | Comments Off on Saturday 06/21/14

Protected: project 2: update 06/21/14

This content is password protected. To view it please enter your password below:

Posted in Genomics | Tagged | Comments Off on Protected: project 2: update 06/21/14

Friday 06/20/14

10:00 am – 11:55 pm

Simulations

  • simulations with more nodes (1 every 300 bp) of blue regions don’t ‘work’,
  • simulation time not long enough for distributions to converge.
  • too many nodes such that larger regions never experience bonding interactions. Maybe bonding energy too low relative the entropy states for this number of molecules.

PHOpeaksSimulate200bpNodeV2

TooMuchExlcusionEffect

PHOpeaksSimulate200bpNode

Closer look at original simulations

  • these behave very well
  • also working out plotting of polymers

SimulationVsDataPHOblue

initial rough version fig
PHOblueFig

New code

  • PlotTubes.m — for visualizing polymers
  • PlotSpheres.m — for visualizing polymers

RC computing, matlab MC simulations

  • in calling matlab from terminal, need to omit the .m part of the filename to get a matlab script to run.
  • also need to omit the filepath — all the slashes no good. just change to the target folder and launch from there.
  • This caused all my code to not launch properly yesterday.
  • finally running and saving data (after fixing a few other small bugs)

Data

  • rpt G06 copied to: ProbBox4:N:\2014-06-17_L3E11toF01, needs to be analyzed
  • Needs analysis: ProBox7: Q:\2014-03-28_L2F02
  • copied from ProBox7 to ProBox5: 2014-01-12_G04
  • copied from STORM2 to ProBox7: L3D01 and L3D02.
  • Started analysis
    • 2014-06-17_L3E11toF01
    • 2014-03-28-L2F02

STORM

  • remove objective heater, clean up cart, transfer system back to Hao
  • new bioptics chamber to arrive by the end of next week (hopefully).
  • recentered beam on camera
  • flattened field using laser adjust mirrors
  • tried to get 561 and 647 centered.

To do

  • stain more black domains! (D04 to D08)
  • Analyze Hao’s cluster data
  • # Analyze cluster data for Ajaz
  • # order primers for my lib 4
  • # order primers for Hao Lib 5
Posted in Summaries | Tagged , , , | Comments Off on Friday 06/20/14

Thursday 06/19/14

10:00 am – 8:15 pm

Working on Python OpenMM simulations

  • goal, attempt to execute some of Mirny’s example code.

Attempting to run demos

  • e.g. scaffoldExample.py
  • complains about notfinding joblib. installed this, required instlaling
  • this complains about not finding mirnylib, which I downloaded along with mirnylab and put both folders independently inside Lib\site-packages.

Attempting to install Cython

  • errors
  • This is kinda stupid that it reports setup.py not found given that it is running the file called setup.py
  • package directory ‘Cython’ does not exist

CythonInstallError

Attempting to install mirnylab\setup.py install

  • same errors

MirnyLabInstallError

The usual joys of python:

  • Endless package dependencies on package dependencies. Many of which are non-standard (e.g. mirnylib, mirnylab, mirnylib numutils_new) and which neither validate their dependencies when you install them nor go and fetch these dependencies on the fly when they encounter errors.
  • It seems to me this would not be too hard to fix — a missing import package is a pretty clear error, and it could direct to a download weblink.

Branching Bogdan’s polymer sim

  • at least this code executes (on Monet as well as Tuck, after a few installs yesterday).
  • modified attractive force (with step functions to enforce short range behavior) and other parameters taken from Minry’s simulations seems to largely solve the exploding polymer problem. Occassional small bursts are still observed. Hopefully these aren’t frequent enough to seriously disrupt the statistics.
  • initial simulation (single run) looks promising for sub volumetric scaling.

Matlab Based simulations

  • running fast scale test using multi-threading locally on Monet
  • wrote script generator to dispatch jobs on Odyssey

Sequential Hybes

Observations

  • by movie 26 (22?) they COT has switched to the keep-everything-on mode = very high background, especially from nonattached probes.
  • Running bleaching
    • first round of bleach movies in 2X SSC (no STORM buffer) still observe pretty decent switching and little spots in previously imaged (‘to-exhaustion’, obviously not true) spots. (10,000 frame movies)
    • even with minimal or no 405, substantial bit of switching.
    • Should probably image all these sequential samples without COT. previously reached this conclusion on project2
    • running second round of bleaching, 10,000 frames. Moved original bleach movies to backup to avoid overwriting.
    • bleaching with 1270 mW 647 (STORM with 270 mW)
  • hot wash at 37C in 50% formamide in 2X SCCT 1 hour
  • wash further 20 min in 2X SCC (remove formamide)
  • STORM now with no COT.
  • pretty clear, 1 hour wash has no free dyes floating around now, unlike first wash. (maybe use less foramide?)
  • forgot to drop power for first movie

Previous F03F04 results

  • with 750 secondary, with drift and chromatic correction
  • good alignment
  • low localization count
    F03F04seqMultiColor
Posted in Summaries | Tagged , , , | Comments Off on Thursday 06/19/14