Distributed problem solving, or multiple-agent problem solving, refers to the process by which several agents interact to achieve goals. This Note describes the development of a framework for implementation of multiple cooperative agents. It also describes experiments and demonstrations with different strategies of cooperation, using air-traffic control and remotely piloted vehicle fleet coordination as the exemplary task domains.