Skip to content
Snippets Groups Projects
  1. Sep 17, 2018
    • noraabiakar's avatar
      Dry-run mode (#582) · a2b39382
      noraabiakar authored and Benjamin Cumming's avatar Benjamin Cumming committed
      Dry-run mode: 
      * An implementation of distributed_context that is used to mimic the performance of running an MPI distributed simulation with n ranks.
      * Verifiable against an MPI run with the same parameters. 
      
      Implementation: 
      * Describe the model on a single domain (tile) and translate it to however many domains we want to mimic using arb::tile and arb::symmetric_recipe. This allows us to know the exact behavior of the entire system by only running the simulation on a single node.
      * Mimic communication between domains using arb::dry_run_context
      
      Example: 
      * dryrun in example/ is a verifiable example of using dry-run mode with mc_cells
      
      Other:
      * Documentation of dry-run mode 
      * unit test for dry_run_context 
      a2b39382
  2. Sep 07, 2018
  3. Sep 06, 2018
    • Sam Yates's avatar
      Clarify vectorization-enabled build errors. (#588) · 1ffccf2d
      Sam Yates authored and Benjamin Cumming's avatar Benjamin Cumming committed
      Fixes #587.
      
      * Eliminate Clang warnings from GCC-tree-optimization bug work-around.
      * Error with static-assert if simd type is used with a missing simd abi.
      * Clarify install documentation regarding use of ARB_VECTORIZE with ARB_ARCH.
      1ffccf2d
  4. Sep 05, 2018
  5. Sep 01, 2018
  6. Aug 30, 2018
    • Benjamin Cumming's avatar
      Opaque Public Context (#576) · d637c8bc
      Benjamin Cumming authored
      Make the execution context presented to users an opaque handle, moving all implementation of the gpu, thread and distributed contexts into the back end.
      
      * move `execution_context` and `distributed_context` definitions to the back end
      * create `execution_context` handle called `context` in the public API
      * provide `make_context` helper functions that build different context configurations (default, user-specified local resources, with MPI)
      * update documentation for all parts of the public API that touch contexts
      * move `distributed_context` docs to the developer documentation (from the public API docs)
      d637c8bc
  7. Aug 29, 2018
  8. Aug 24, 2018
  9. Aug 22, 2018
  10. Aug 20, 2018
    • Sam Yates's avatar
      Global temperature for NMODL mechanisms. (#565) · fa0d7aef
      Sam Yates authored and Benjamin Cumming's avatar Benjamin Cumming committed
      Global temperature for mechanisms.
      
      * Make 'celsius' magic in modcc: now an indexed variable.
      * Add a new temperature data source for indexed variables.
      * Add support to printers for indexed variables that reference a scalar.
      * Check that indexed variables aren't used in PROCEDURE blocks (this is a problem not just for 'celsius').
      * Modify built-in mod files to pass celsius as a parameter to rates() procedures.
      * Add global temperature to shared_state classes, and initialize through backend mechanism superclasses.
      * Add some infrastructure for unit-test only mechanisms.
      * Set modcc flags globally in top level CMakeLists.txt.
      * Add test mechanism/module for checking celsius setting.
      * Add unit test for multicore and gpu mechanism celsius setting.
      * Make common mechanism private field data access helper for unit tests.
      * Use helper in temperature, synapses tests.
      * Fix warning in `distribued_context.hpp` about errant semicolon.
      * Fix global scal...
      fa0d7aef
  11. Aug 06, 2018
    • Sam Yates's avatar
      Bugfix/build osx macports (#563) · 3bafa1b3
      Sam Yates authored
      Two MacPorts/gcc7 issues:
      
      std::uint64_t is unsigned long long on OS X, breaking an assumption about size_t in the distributed_context interface.
      Problems with missing errno defines in the standard library headers.
      With MacPorts gcc7, the installed c++config.h defines _GLIBCXX_HAVE_EOWNERDEAD and _GLIBCXX_HAVE_ENOTRECOVERABLE, but the corresponding errno defines are not provided by
      sys/errno.h unless __DARWIN_C_SOURCE, which takes its value from _POSIX_C_SOURCE if defined, is greater than or equal to 200809L. Technically a MacPorts configuration bug? but easily worked around.
      
      Use basic integral types for communication collectives interfaces.
      Define _POSIX_C_SOURCE to be 200809L for glob.cpp.
      Fixes #562.
      3bafa1b3
  12. Jul 31, 2018
    • Sam Yates's avatar
      Split multi_event_stream.cu implementation. (#556) · ac581c6b
      Sam Yates authored
      * Remove dependency on memory library and range utils from `multi_event_stream.cu` source.
      
      Fixes #545
      ac581c6b
    • noraabiakar's avatar
      Manage distributed_context using shared pointers (#555) · 0d6b365a
      noraabiakar authored and Sam Yates's avatar Sam Yates committed
      * Replace distributed_contest with shared_ptr<distributed_context> in execution_context and pass around the shared pointer instead of a raw pointer.
      * Fix construction of mpi_context
      * Remove num_threads() from arb and arb::threading. Modify mpi_context so it also returns a shared_ptr. proc_allocation is initialized from execution context to determine available resources.
      * Rename threading backend files. Delete useless files.
      * Pass execution_context by const reference or value.
      * Remove code duplication in thread_system constructors.
      0d6b365a
  13. Jul 26, 2018
    • Sam Yates's avatar
      Update install docs for architecture build options. (#489) · 845077e6
      Sam Yates authored and Benjamin Cumming's avatar Benjamin Cumming committed
      * Update the install docs for architecture build options
      * Update to reflect new install target
      845077e6
    • Sam Yates's avatar
      Return view from schedule, replace time_seq. (#536) · 0d20df25
      Sam Yates authored
      Reduce redundant functionality across event_generator, time_seq
      and schedule by providing a low-heap overhead interface to schedule
      and using that for time sequences in event_generator and specialized
      cell groups.
      
      * Have schedule return pair of pointers as view to generated times.
      * Fix missing DEBUG/TRACE functionality.
      * Use rate instead of mean_dt for Poisson schedule.
      * Move merge_events() functionality to simulator.cpp.
      * Migrate event_generator to event span interface.
      * Migrate tourney_tree to event span interface.
      * Only invoke tourney_tree merge if generators have events in the epoch.
      * Use schedule for times in event_generator implementations.
      * Replace seq_generator with explicit_generator that keeps a copy of events.
      * Replace vector_backed_generator and poisson_generator with schedule_generator.
      * Replace time_seq uses with schedule.
      * Add default empty schedule.
      * Move rounding error test for regular time sequence into schedule test.
      * Update sampling API documentation for schedule.
      0d20df25
    • noraabiakar's avatar
      Use correct profiling flag (#549) · 487a65e9
      noraabiakar authored and Benjamin Cumming's avatar Benjamin Cumming committed
      Use correct profiling and mpi flags.
      Fix profiler doc
      487a65e9
  14. Jul 25, 2018
    • Benjamin Cumming's avatar
      Remove `memory::array` from `arb::tree` (#547) · af5fe62a
      Benjamin Cumming authored
      This small refactor simplifies the interface and implementation of the `tree` type.
      * use `std::vector` instead of `memory::array` for internal storage in `arb::tree`
      * return a `util::range` intstead of a view for `tree::children(int)`
      * remove unused functionality for changing the root of a tree.
      af5fe62a
    • noraabiakar's avatar
      fix profiler (#548) · 177cce0d
      noraabiakar authored and Benjamin Cumming's avatar Benjamin Cumming committed
      Add initialize method to the profiler to set up the needed threading parameters given a simulation's task system.
      177cce0d
  15. Jul 24, 2018
    • noraabiakar's avatar
      task_system as part of an execution_context (#537) · 7a6c1031
      noraabiakar authored and Benjamin Cumming's avatar Benjamin Cumming committed
      - Task system is no longer a single system private to the implementation of the threading backend and used everywhere. A separate task_system can be used (with a specified number of threads) for every simulation.
      - arb::execution_context is the interface to task_system  and the previously defined distributed_context
      - TBB and serial support has been removed. Cthreads is the only threading backend available. 
      7a6c1031
  16. Jul 20, 2018
  17. Jul 19, 2018
    • noraabiakar's avatar
      Cthreads: implement task queue per thread with task stealing (#528) · 4d63988a
      noraabiakar authored and Sam Yates's avatar Sam Yates committed
      Cthreads classes:
      - Notification queue : Manages tasks: tries or forces popping and pushing tasks.  
      - Task system : manages the notifications queues; controls which queue to pop from/push to; controls spinning on queues if necessary; manages creating/joining threads. Is a singleton.
      - Task group : manages synchronization on a group of tasks. 
      
      Operation: 
      - Each thread has an associated queue
      - Task system _tries to_ push tasks in one of the available queues. If it is unable to acquire a lock on a queue, it tries the next in a round robin fashion. After it loops all queues if it still hasn't successfully pushed the task, it spins on a single queue until lock is acquired and task is pushed. 
      - Task system _tries to_ pop a task from the calling thread's queue. If it is unable to acquire the lock, it tries to steal the task from another thread's queue, in a round robin loop. If it is still unable to pop a task, it spins on its the calling thread's queue until the lock is acquired. 
      - Task group keeps a counter for the number of tasks in the group which it increments/decrements when calling push/pop on the task system. The counter is used to know when all tasks in the group have been executed. 
      
      Unit tests: 
      - Basic tests to pop/push from notification_queue, task_system and task_group. 
      - Simple tests for deadlock 
      - Simple tests for correctness 
      
      Benchmark: 
      - Benchmarks performance for various task sizes
      4d63988a
  18. Jul 13, 2018
    • noraabiakar's avatar
      fix to compile bench without mpi (#533) · bbe99176
      noraabiakar authored and Benjamin Cumming's avatar Benjamin Cumming committed
      bbe99176
    • Sam Yates's avatar
      Feature/lib install target part 4 (#531) · d6af0c4d
      Sam Yates authored and Benjamin Cumming's avatar Benjamin Cumming committed
      All example code and validation tests no longer require access to private include directories. This provides the minimal requirement for an installable target
      
      Note that it is still not possible to separately build mechanisms from NMODL with just the public includes, and there is not yet any package configuration file creation for use with CMake or pkg-config.
      
      * Replace `hw::node_info` with `proc_allocation`, describing local resources for the purposes of domain decomposition.
      * Group processor counting and gpu counting implementation under `node_info.cpp`.
      * Remove `domain_decomposition` dependency from `cell_group_factory.hpp` so we can use the latter to test for backend support for a cell kind.
      * Add `arb::cell_kind_implementation()` which performs the mapping from cell kind and backend kind to a `cell_group_ptr`-producing function (this will then become the site for custom cell group kind mapping support in future work).
      * Move headers for aux library into `aux/include/aux`, so that there is less ambiguity in header location within test and example code.
      * Simplify a little the affinity scanning code.
      * Add `sysconf()` and `std::thread::hardware_concurrency()` fallbacks for processor count determination.
      * Move `util::mask_stream`, `util::path`, `util::scope_exit` into aux header.
      * Remove `util::nop`.
      * Remove `io::exporter` and `io::exporter_spike_file`; replace with simpler interface in `aux::spike_emitter`.
      * Move `load_balance.hpp`, `math.hpp`, `scwio.hpp` into public includes.
      * Move path, glob and scope_exit utilities to aux lib.
      * Move cell group size-based partitioning functionality into partition_load_balance, through the use of new `partition_hint` structure.
      * Remove brunel example specific partitioner.
      * Move brunel example option code out of `::arb` namespace.
      * Move swc routines out of `arb::io` and into `arb::`.
      * Specialize public swc-routines to take a vector of swc_record objects instead of an arbitrary sequence; place implementations into swcio.cpp.
      * Remove dependency on `util/strprintf.hpp` from lmorpho.
      * Remove `arb::math::min`, `arb::math::max`.
      * Remove range utility dependence from validation tests: add piece-wise linear interpolator in test/validation/interpolate.hpp; remove `times` and `values` adaptors for simple trace data; add test/validation/util.hpp with generic size function and a `to_string` for `backend_kind`.
      * Add `aux::open_or_throw` helper function to replicate no-overwrite spike output behaviour in example applications.
      * Add `aux::strsub` simple string substitution function for use in examples, so as to avoid a `util::strprintf` or `util::pprintf` dependency.
      * Remove arbor private header dependencies from examples and validation tests.
      d6af0c4d
  19. Jul 10, 2018
  20. Jul 06, 2018
    • Sam Yates's avatar
      Remove NDEBUG tests in memory utils. (#523) · 0c9906bd
      Sam Yates authored and Benjamin Cumming's avatar Benjamin Cumming committed
      Fixes #182.
      0c9906bd
    • Sam Yates's avatar
      Migrate source/build to c++14 ... · 3ee79191
      Sam Yates authored and Benjamin Cumming's avatar Benjamin Cumming committed
      Migrate source/build to c++14                                                                                                                    (#522)
      
      * Update `CMakeLists.txt` for C++14 option.
      * Update to gcc 6 minimum.
      * Update travis CI from gcc-5 to gcc-6
      * Use `std::..._t` style type traits, replacing `util::` aliases.
      * Use `std::cbegin`, `std::cend`, and `std::make_unique`, replacing `util::` versions.
      * Remove `DEDUCED_RETURN_TYPE` macros.
      * Remove redundant return type specifications.
      * Use correct ADL for `begin` and `end` in (almost all) the range utilities.
      * Remove redundant `mechinfo` ctor (aggregate initialization suffices).
      * Use lambda capture initializers where appropriate.
      * Use generic `std::equal_to`.
      * Use variable templates for `math::infinity` and `math::pi`.
      * Remove `enum_hash` workaround.
      * Use `""s` string literals where we were using our own `""_s` construction.
      * Use generic lambda for recursive lambda instead of `std::function` wrapper.
      * Use generic lambda for generic arithmetic tests.
      
      Fixes #358.
      3ee79191
    • Sam Yates's avatar
      Fix GPU breakage in last PR (#520) · 26eda785
      Sam Yates authored and Benjamin Cumming's avatar Benjamin Cumming committed
      Who broke the build? Sam did!
      26eda785
  21. Jul 05, 2018
    • Sam Yates's avatar
      Test for xlC and refuse to build with it. (#519) · 775fe807
      Sam Yates authored and Benjamin Cumming's avatar Benjamin Cumming committed
      Fixes issue #517.
      
      Deprecate the IBM xlC compiler.
      xlC generates code that is an order of a magnitude slower than gcc, while generating spurious warnings, and requiring hacks and workarounds to pass all tests.
      Supporting it makes no sense.
      
      * Add test and fatal error for xlC detection in CheckCompilerXLC.cmake.
      * Move xlC 13 misdetection work around to CheckCompilerXLC.cmake.
      * Remove xlC-specific compatibility workarounds from code.
      775fe807
    • Sam Yates's avatar
      Feature/lib install target part 3 (#518) · 40612fa7
      Sam Yates authored and Benjamin Cumming's avatar Benjamin Cumming committed
      This time we're moving `recipe.hpp` and `simulation.hpp`, plus the requirements they bring.
      
      Code changes:
      * Pimplize `simulation`.
      * Consolidate arbor exceptions: all non-cell kind specific exceptions that might be expected to reach user code now have consistent messages and fit in an exception hierarchy based at `arb::arbor_exception`. Internal errors throw an `arb::arbor_internal_error` exception.
      * Renamed `postsynaptic_spike_event` to `spike_event`. (Note: `pse_vector` name is unchanged.)
      * Repurposed `pprintf` and moved it into `strprintf.h` — further consolidation is a TODO.
      * Made a generic `util::to_string` to avoid redundancy of `operator<<` overloads and other `to_string` definitions. Defaults to ADL `to_string`, `std::to_string`, and finally tries using `operator<<`.
      40612fa7
  22. Jul 03, 2018
    • Sam Yates's avatar
      Move cell description types to public includes. (#508) · a1894edc
      Sam Yates authored and Benjamin Cumming's avatar Benjamin Cumming committed
      Further work to public install target.
      
      * Move SIMD classes, cell description classes, simple sampler to public include.
      * Rename `cell` to `mc_cell`, `segment` to `mc_segment`, and remove `_description` from cell description class names and includes.
      * Move `compartment_model` out of `mc_cell` interface and use only in `fvm_layout.cpp`.
      * (Provisionally) remove area/volume methods on `mc_cell` and `mc_segment`.
      a1894edc