Dynamically Changing Parallelism with the Asynchronous Sequential Data Flows

A statically typed version of the data driven functional parallel computing model is proposed. It enables a representation of dynamically changing parallelism by means of asynchronous serial data flows. We consider the features of the syntax and semantics of the statically typed data driven functional parallel programming language Smile that supports asynchronous sequential flows. Our main idea is to apply the Hoar concept of communicating sequential processes to the computation control on the data readiness. It is assumed that on the data readiness a control signal is emitted to inform the processes about the occurrence of certain events. The special feature of our approach is that the model is extended with the special asynchronous containers that can generate events on their partial filling. These containers are a stream and a swarm, each of which has its own specifics. A stream is used to process data which have identical type. The data comes sequentially and asynchronously at arbitrary time moments. The number of the incoming data elements is initially unknown, so the processing completes on the signal of the end of the stream. A swarm is used to contain independent data of the same type and may be used for the massive parallel operations performing. Unlike a stream, the swarm’s size is fixed and known in advance. General principles of the operations with the asynchronous sequential flows with an arbitrary order of data arrival are described. The use of the streams and the swarms in various situations is considered. We propose the language constructions which allow us to operate the swarms and streams and describe the specifics of their application. We provide the sample functions to illustrate the use of the different approaches to description of the parallelism: recursive processing of the asynchronous flows, processing of the flows in an arbitrary or predefined order of operations, direct access and access by the reference to the elements of the streams and swarms, pipelining of calculations. We give a preliminary parallelism assessment which depends on the ratio of the rates of data arrival and their processing. The proposed methods can be used in the development of the future languages and tool-kits of architecture-independent parallel programming.

1. A. I. Legalov, “The Usage of Asynchronous Lists within the Dataflow Model of Computations”, in The Third Siberian School Seminar on Parallel Computations, In Russian, 2006, pp. 113–120.

2. C. A. R. Hoar, Communicating Sequential Processes, 8. Communications of the ACM, 1978, vol. 21, pp. 666–677.

3. M. Diaz, Petri Nets: Fundamental Models, Verification and Applications. UK: ISTE Ltd, 2009.

4. A. I. Legalov, “About Computation Control in Parallel System and Programming Languages”, Nauchiy Vestnik NGTU, vol. 18, no. 3, pp. 63–72, 2004, In Russian.

5. A. I. Legalov, V. S. Vasiliev, and I. V. Matkovsky, “Changing Computing Management Strategies for Architecture-Independent Parallel Programming”, in Proceedings of the XIX All-Russian Scientific Conference “Scientific Service on the Internet”, In Russian, 2017, pp. 341–350.

6. A. V. Redkin and A. I. Legalov, “Event Based Control of Computations for Functional Dataflow Programming”, Scientific Bulletin of Novosibirsk State Technical University, vol. 32, no. 3, pp. 111–120, 2008, In Russian.

7. A. I. Legalov, A. V. Redkin, and I. V. Matkovsky, “Data Driven Functional Parallel Programming with Data Coming Asynchronously”, in Parallel Computing Technologiws (PCT’2009), In Russian, 2009, pp. 573–578.

8. A. I. Legalov, I. A. Legalov, and I. V. Matkovsky, “Specifics of Semantics of a Statically Typed Language of Functional and Dataflow Parallel Programming”, in Scientific Conference “Scientific Service on the Internet”, 2019, pp. 489–500.

9. A. I. Legalov, “Functional Language for Architecture-Independent Programming”, Computation technologies, vol. 10, no. 1, pp. 71–89, 2005, In Russian.