SIAM Digital Library
 
 
 

SIAM J. on Computing

All Journal content published prior to 1997 is part of LOCUS.

Search Issue | RSS Feeds RSS
Previous Issue

1999

Volume 28, Issue 6, pp. 1923-2299


Tree Data Structures for N-Body Simulation

Richard J. Anderson

SIAM J. Comput. 28, pp. 1923-1940 (18 pages) | Cited 8 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
In this paper, we study data structures for use in N-body simulation. We concentrate on the spatial decomposition tree used in particle-cluster force evaluation algorithms such as the Barnes--Hut algorithm. We prove that a k-d tree is asymptotically inferior to a spatially balanced tree. We show that the worst case complexity of the force evaluation algorithm using a k-d tree is $\Theta(n\log^3n\log L)$ compared with $\Theta(n\log L)$ for an oct-tree. (L is the separation ratio of the set of points.)
We also investigate improving the constant factor of the algorithm and present several methods which improve over the standard oct-tree decomposition. Finally, we consider whether or not the bounding box of a point set should be "tight" and show that it is safe to use tight bounding boxes only for binary decompositions. The results are all directly applicable to practical implementations of N-body algorithms.

The Power of Vacillation in Language Learning

John Case

SIAM J. Comput. 28, pp. 1941-1969 (29 pages) | Cited 5 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
Some extensions are considered of Gold's influential model of language learning by machine from positive data. Studied are criteria of successful learning featuring convergence in the limit to vacillation between several alternative correct grammars. The main theorem of this paper is that there are classes of languages that can be learned if convergence in the limit to up to (n + 1) exactly correct grammars is allowed but which cannot be learned if convergence in the limit is to no more than n grammars, where the no more than n grammars can each make finitely many mistakes. This contrasts sharply with results of Barzdin and Podnieks and, later, Case and Smith for learnability from both positive and negative data.
A subset principle from a 1980 paper of Angluin is extended to the vacillatory and other criteria of this paper. This principle provides a necessary condition for avoiding overgeneralization in learning from positive data. It is applied to prove another theorem to the effect that one can optimally eliminate half of the mistakes from final programs for vacillatory criteria if one is willing to converge in the limit to infinitely many different programs instead.
Child language learning may be sensitive to the order or timing of data presentation. It is shown, though, that for the vacillatory success criteria of this paper, there is no loss of learning power for machines which are insensitive to order in several ways simultaneously. For example, partly set-driven machines attend only to the set and length of sequence of positive data, not the actual sequence itself. A machine M is weakly n-ary order independent ${\stackrel{\rm def}\Leftrightarrow}$ for each language L on which, for some ordering of the positive data about L, M converges in the limit to a finite set of grammars, there is a finite set of grammars D (of cardinality $\leq n$) such that M converges to a subset of this same D for each ordering of the positive data for L. The theorem most difficult to prove in the paper implies that machines which are simultaneously partly set-driven and weakly n-ary order independent do not lose learning power for converging in the limit to up to n grammars. Several variants of this theorem are obtained by modifying its proof, and some of these variants have application in this and other papers. Along the way it is also shown, for the vacillatory criteria, that learning power is not increased if one restricts the sequence of positive data presentation to be computable. Some of these results are nontrivial lifts of prior work for the n=1 case done by the Blums; Wiehagen; Osherson, Stob, and Weinstein; Schäfer; and Fulk.

An Associative Block Design ABD(8,5)

A. E. Brouwer

SIAM J. Comput. 28, pp. 1970-1971 (2 pages)

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
An associative block design is a certain balanced partition of a hypercube into smaller hypercubes. We construct such a design, thus settling the smallest open case.

On the Robustness of Functional Equations

Ronitt Rubinfeld

SIAM J. Comput. 28, pp. 1972-1997 (26 pages) | Cited 14 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
In this paper, we study the general question of how characteristics of functional equations influence whether or not they are robust. We isolate examples of properties which are necessary for the functional equations to be robust. On the other hand, we show other properties which are sufficient for robustness. We then study a general class of functional equations, which are of the form $\forall x,y F[f(x-y), f(x+y), f(x),f(y)]=0, where F is an algebraic function. We give conditions on such functional equations that imply robustness.
Our results have applications to the area of self-testing/correcting programs. We show that self-testers and self-correctors can be found for many functions satisfying robust functional equations, including algebraic functions of trigonometric functions such as $\tan{x},{1 \over {1+\cot{x}}},$ ${Ax \over {1-Ax}},cosh x.

New Results on the Old k-opt Algorithm for the Traveling Salesman Problem

Barun Chandra, Howard Karloff, and Craig Tovey

SIAM J. Comput. 28, pp. 1998-2029 (32 pages) | Cited 6 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
Local search with k-change neighborhoods is perhaps the oldest and most widely used heuristic method for the traveling salesman problem, yet almost no theoretical performance guarantees for it were previously known. This paper develops several results, some worst-case and some probabilistic, on the performance of 2- and k-opt local search for the traveling salesman problem, with respect to both the quality of the solution and the speed with which it is obtained.

Parallel Complexity of Numerically Accurate Linear System Solvers

Mauro Leoncini, Giovanni Manzini, and Luciano Margara

SIAM J. Comput. 28, pp. 2030-2058 (29 pages) | Cited 1 time

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
We prove a number of negative results about practical (i.e., work efficient and numerically accurate) algorithms for computing the main matrix factorizations. In particular, we prove that the popular Householder and Givens methods for computing the QR decomposition are P-complete, and hence presumably inherently sequential, under both real and floating point number models. We also prove that Gaussian elimination (GE) with a weak form of pivoting, which aims only at making the resulting algorithm nondegenerate, is likely to be inherently sequential as well. Finally, we prove that GE with partial pivoting is P-complete over GF(2) or when restricted to symmetric positive definite matrices, for which it is known that even standard GE (no pivoting) does not fail. Altogether, the results of this paper give further formal support to the widespread belief that there is a tradeoff between parallelism and accuracy in numerical algorithms.

Approximate Complex Polynomial Evaluation in Near Constant Work Per Point

John H. Reif

SIAM J. Comput. 28, pp. 2059-2089 (31 pages) | Cited 3 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
Given the n complex coefficients of a degree n-1 complex polynomial, we wish to evaluate the polynomial at a large number $m \ge n$ of points on the complex plane. This problem is required by many algebraic computations and so is considered in most basic algorithm texts (e.g., [A.V. Aho, J. E. Hopcroft, and J. D. Ullman, The Design and Analysis of Computer Algorithms, Addison-Wesley, 1974]). We assume an arithmetic model of computation, where on each step we can execute an arithmetic operation, which is computed exactly. All previous exact algorithms [C. M. Fiduccia, Proceeding} 4th Annual ACM Symposium on Theory of Computing, 1972, pp. 88--93; H. T. Kung, Fast Evaluation and Interpolation, Carnegie-Mellon, 1973; A. B. Borodin and I. Munro, The Computational Complexity of Algebraic and Numerical Problems, American Elsevier, 1975; V. Pan, A. Sadikou, E. Landowne, and O. Tiga, Comput. Math. Appl., 25 (1993), pp. 25--30] cost at least work $\Omega(\log^2 n)$ per point, and previously, there were no known approximation algorithms for complex polynomial evaluation within the unit circle with work bounds better than the fastest known exact algorithms. There are known approximation algorithms [V. Rokhlin, J. Complexity, 4 (1988), pp. 12--32; V. Y. Pan, J. H. Reif, and S. R. Tate, in Proceedings 32nd Annual IEEE Symposium on Foundations of Computer Science, 1992, pp. 703--713] for polynomial evaluation at real points, but these do not extend to evaluation at general points on the complex plane.
We provide approximation algorithms for complex polynomial evaluation that cost, in many cases, near constant amortized work per point. Let $k = \log(|P|/\epsilon)$, where |P| is the sum of the moduli of the coefficients of the input polynomial P(z). Let {\it ${\tilde{P}}(z_j)$ be an $\epsilon$-approx of $P(z)$} if $\epsilon$ upper bounds the modulus of the error of the approximation ${\tilde{P}}(z_j)$ at each evaluation point zj, that is, $|P(z_j)-{\tilde{P}}(z_j)| \le \epsilon;$ note that $\epsilon$ is an absolute error bound rather than a relative error bound. In many applications (particularly in signal processing) the evaluation points zj are fixed and require only polylogarithmic $k = \log(|P|/\epsilon) = O(\log^{O(1)} n)$; for these cases we get a surprising reduction in work by use of approximation algorithms, as compared to the fastest known exact algorithms.
We $\epsilon$-approx complex degree n-1 polynomial evaluation at $m \ge n\log n/\log^2 k $ fixed points on or within the unit disk in the complex plane in amortized work O(log2k) per point, which is O(log2 log n) for polylogarithmic k. If the m points are not fixed, then we have increased amortized work O(log2k + log m) per point, which is O(log m) for polylogarithmic k and $m \ge n\log n/\log k,$ and is still substantially below the previous bound of $\Omega(\log^2 m)$ for known exact algorithms. We further reduce our amortized bounds for special sets of evaluation points widely used in signal processing applications. The chirp transform is equivalent to evaluating a complex degree n-1 polynomial at the chirp points, which are $\zeta^j, j = 0,\dots,m-1$, for some fixed complex number $\zeta.$ We $\epsilon$-approx complex degree $n-1$ polynomial evaluation at these $m$ chirp points, where $m \ge n \log n/\log^2 k$ and $|\zeta| \le 1$ % or (ii) $m \ge n$ and $|\zeta| \le $ a function that limits to $1$ %for %$k = o(n)$ and large $n$) in amortized work O(log k) per point, whereas the previous best bounds for exact evaluation (via the chirp transform) were $\Omega(\log m)$ per point [A. V. Aho, K. Steiglitz, and J. D. Ullman, SIAM J. Comput., 4 (1975), pp. 533--539].
Using instead a reduction to approximate real polynomial evaluation (by interpolation at the Chebyshev points), in total work O(n log k), we $\epsilon$-approx the evaluation of a degree n polynomial at the first n powers of the n'th root of unity, where $n' \ge \Omega(n^2/k), $ and $\epsilon$-approx the n-point DFT for certain inputs with descending coefficient magnitude.
All of our results require polylogarithmic (that is, logO(1)n)depth with the same work bounds.We also provide a lower bound for a wide class of schemes for approximate evaluation of a degree n-1 polynomial on the unit circle; namely, we prove that if a scheme uses an approximation polynomial of degree k-1, then it can be convergent only over a small fraction O(k/n) of the unit circle. We believe this is the first lower bound of this sort proved, and the proof uses an interesting reduction to the approximation of a matrix product by a matrix of reduced rank.

Optimal Search in Trees

Yosi Ben-Asher, Eitan Farchi, and Ilan Newman

SIAM J. Comput. 28, pp. 2090-2102 (13 pages) | Cited 4 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
It is well known that the optimal solution for searching in a finite total order set is binary search. In binary search we divide the set into two "halves" by querying the middle element and continue the search on the suitable half. What is the equivalent of binary search when the set P is partially ordered? A query in this case is to a point $x\in P$, with two possible answers: "yes" indicates that the required element is "below" x or "no" if the element is not below x. We show that the problem of computing an optimal strategy for search in posets that are tree-like (or forests) is polynomial in the size of the tree and requires at most O(n4 log3n) steps. Optimal solutions of such search problems are often needed in program testing and debugging, where a given program is represented as a tree and a bug should be found using a minimal set of queries. This type of search is also applicable in searching classified large tree-like databases (e.g., the Internet).

Weak Random Sources, Hitting Sets, and BPP Simulations

Alexander E. Andreev, Andrea E. F. Clementi, José D. P. Rolim, and Luca Trevisan

SIAM J. Comput. 28, pp. 2103-2116 (14 pages) | Cited 1 time

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
We show how to simulate any BPP algorithm in polynomial time by using a weak random source of r bits and min-entropy $r^{\gamma}$ for any $\gamma >0$. This follows from a more general result about sampling with weak random sources. Our result matches an information-theoretic lower bound and solves a question that has been open for some years. The previous best results were a polynomial time simulation of RP [M. Saks, A. Srinivasan, and S. Zhou, Proc. 27th ACM Symp. on Theory of Computing, 1995, pp. 479--488] and a quasi-polynomial time simulation of BPP [A. Ta-Shma, Proc. 28th ACM Symp. on Theory of Computing, 1996, pp. 276--285].
Departing significantly from previous related works, we do not use extractors; instead, we use the OR-disperser of Saks, Srinivasan, and Zhou in combination with a tricky use of hitting sets borrowed from [Andreev, Clementi, and Rolim, J. ACM, 45 (1998), pp. 179--213].

Dominators in Linear Time

Stephen Alstrup, Dov Harel, Peter W. Lauridsen, and Mikkel Thorup

SIAM J. Comput. 28, pp. 2117-2132 (16 pages) | Cited 5 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
A linear-time algorithm is presented for finding dominators in control flow graphs.

Approximating Capacitated Routing and Delivery Problems

Prasad Chalasani and Rajeev Motwani

SIAM J. Comput. 28, pp. 2133-2149 (17 pages) | Cited 18 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
We provide approximation algorithms for some capacitated vehicle routing and delivery problems. These problems can all be viewed as instances of the following k-delivery TSP: given n source points and n sink points in a metric space, with exactly one item at each source, find a minimum length tour by a vehicle of finite capacity k to pick up and deliver exactly one item to each sink. The only known approximation algorithm for this family of problems is the 2.5-approximation algorithm of Anily and Hassin [ Networks, 22 (1992), pp. 419--433] for the special case k=1. For this case, we use matroid intersection to obtain a 2-approximation algorithm. Based on this algorithm and some additional lower bound arguments, we devise a factor-approximation for k-delivery TSP with arbitrary finite k. We also present a 2-approximation algorithm for the case $k = \infty$.
We then initiate the study of dynamic variants of k-delivery TSP that model problems in industrial robotics and other applications. Specifically, we consider the situation where a robot arm (with finite or infinite capacity) must collect n point-objects moving in the Euclidean plane, and deliver them to the origin. The point-objects are moving in the plane with known, identical velocities---they might, for instance, be on a moving conveyor belt. We derive several useful structural properties that lead to constant-factor approximations for problems of this type that are relevant to the robotics application. Along the way, we show that maximum latency TSP is implicit in the dynamic problems, and that the natural "farthest neighbor" heuristic produces a good approximation for several notions of latency.

On Floor-Plan of Plane Graphs

Xin He

SIAM J. Comput. 28, pp. 2150-2167 (18 pages) | Cited 5 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
A floor-plan is a rectangle partitioned into a set of disjoint rectilinear polygonal regions (called modules). A floor-plan F represents a plane graph G as follows: Each vertex of G corresponds to a module of F and two vertices are adjacent in G iff their corresponding modules share a common boundary. Floor-plans find applications in VLSI chip design.
If a module M is a union of k disjoint rectangles, M is called a k-rectangle module. It was shown in [K.-H. Yeap and M. Sarrafzadeh, SIAM J. Comput., 22 (1993), pp. 500--526] that every triangulated plane graph G has a floor-planusing 1-, 2-, and 3-rectangle modules. In this paper, we present a simple linear time algorithm that constructs a floor-plan for G using only 1- and 2-rectangle modules.

Horn Extensions of a Partially Defined Boolean Function

Kazuhisa Makino, Ken-ichi Hatanaka, and Toshihide Ibaraki

SIAM J. Comput. 28, pp. 2168-2186 (19 pages)

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
Given a partially defined Boolean function (pdBf) (T,F), we investigate in thispaper how to find a Horn extension $f: \{0,1\}^n \mapsto \{0,1\}$, which is consistent with (T,F), where $T \subseteq \{0,1\}^n$ denotes a set of true Boolean vectors (or positive examples) and $F \subseteq \{0,1\}^n$ denotes a set of false Boolean vectors (or negative examples). Given a pdBf (T,F), it is known that the existence of a Horn extension can be checked in polynomial time. As there are many Horn extensions, however, we consider those extensions f which have maximal and minimal sets T(f) of the true vectors of f, respectively. For a pdBf (T,F), there always exists the unique maximal (i.e., maximum) Horn extension, but there are in general many minimal Horn extensions. We first show that a polynomial time membership oracle can be constructed for the maximum extension, even if its disjunctive normal form (DNF) can be very long. Our main contribution is to show that checking if a given Horn DNF represents a minimal extension and generating a Horn DNF of a minimal Horn extension can both be done in polynomial time. We also can check in polynomial time if a pdBf (T,F) has the unique minimal Horn extension. However, the problems of finding a Horn extension f with the smallest |T(f)| and of obtaining a Horn DNF, whose number of literals is smallest, are both NP-hard.

Fast Approximate Graph Partitioning Algorithms

Guy Even, Joseph (Seffi) Naor, Satish Rao, and Baruch Schieber

SIAM J. Comput. 28, pp. 2187-2214 (28 pages) | Cited 9 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
We study graph partitioning problems on graphs with edge capacities and vertex weights. The problems of b-balanced cuts and k-balanced partitions are unified into a new problem called minimum capacity $\rho$-separators. A $\rho$-separator is a subset of edges whose removal partitions the vertex set into connected components such that the sum of the vertex weights in each component is at most $\rho$ times the weight of the graph. We present a new and simple O(log n)-approximation algorithm for minimum capacity $\rho$-separators which is based on spreading metrics yielding an O(log n)-approximation algorithm both for b-balanced cuts and k-balanced partitions. In particular, this result improves the previous best known approximation factor for k-balanced partitions in undirected graphs by a factor of O(log k). We enhancethese results by presenting a version of the algorithm that obtains an O(log OPT)-approximation factor. The algorithm is based on a technique called spreading metrics that enables us to formulate directly the minimum capacity $\rho$-separator problem as an integer program. We also introduce a generalization called the simultaneous separator problem, where the goal is to find a minimum capacity subset of edges that separates a given collection of subsets simultaneously. We extend our results to directed graphs for values of $\rho \geq 1/2$. We conclude with an efficient algorithm for computing an optimal spreading metric for $\rho$-separators. This yields more efficient algorithms for computing b-balanced cuts than were previously known.

An Optimal Algorithm for Euclidean Shortest Paths in the Plane

John Hershberger and Subhash Suri

SIAM J. Comput. 28, pp. 2215-2256 (42 pages) | Cited 26 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
We propose an optimal-time algorithm for a classical problem in plane computational geometry: computing a shortest path between two points in the presence of polygonal obstacles. Our algorithm runs in worst-case time O(n log n) and requires O(n log n) space, where n is the total number of vertices in the obstacle polygons. The algorithm is based on an efficient implementation of wavefront propagation among polygonal obstacles, and it actually computes a planar map encoding shortest paths from a fixed source point to all other points of the plane; the map can be used to answer single-source shortest path queries in O(log n) time. The time complexity of our algorithm is a significant improvement over all previously published results on the shortest path problem. Finally, we also discuss extensions to more general shortest path problems, involving nonpoint and multiple sources.

Tight Lower Bounds for st-Connectivity on the NNJAG Model

Jeff Edmonds, Chung Keung Poon, and Dimitris Achlioptas

SIAM J. Comput. 28, pp. 2257-2284 (28 pages) | Cited 1 time

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
Directed st-connectivity is the problem of deciding whether or not there exists a path from a distinguished node s to a distinguished node t in a directed graph. We prove a time--space lower bound on the probabilistic NNJAG model of Poon [ Proc. 34th Annual Symposium on Foundations of Computer Science, Palo Alto, CA, 1993, pp. 218--227]. Let n be the number of nodes in the input graph and S and T be the space and time used by the NNJAG, respectively. We show that, for any $\delta > 0$, if an NNJAG uses space $S \in O(n^{1-\delta})$, then $T \in 2^{ \Omega(\log^2 (n/S)) }$; otherwise $T \in 2^{ \Omega( \log^2({n\log n \over S}) / \log\log n )} \times (nS / \log n)^{1/2}$. (In a preliminary version of this paper by Edmonds and Poon [Proc. 27th Annual ACM Symposium on Theory of Computing, Las Vegas, NV, 1995, pp. 147--156.], a lower bound of $T \in 2^{ \Omega( \log^2({n\log n \over S}) / \log\log n )} \times (nS/\log n)^{1/2}$ was proved.) Our result greatly improves the previous lower bound of $ST \in \Omega(n^2/\log n)$ on the JAG model by Barnes and Edmonds [ Proc. 34th Annual Symposium on Foundations of Computer Science, Palo Alto, CA, 1993, pp. 228--237] and that of $S^{1/3}T \in \Omega(n^{4/3})$ on the NNJAG model by Edmonds [ Time-Space Lower Bounds for Undirected and Directed ST-Connectivity on JAG Models, Ph.D. thesis, University of Toronto, Toronto, ON, Canada, 1993]. Our lower bound is tight for $S \in O(n^{1-\delta})$, for any $\delta > 0$, matching the upper bound of Barnes \etal [ Proc. 7th Annual IEEE Conference on Structure in Complexity Theory, Boston, MA, 1992, pp. 27--33]. As a corollary of this improved lower bound, we obtain the first tight space lower bound of $\Omega( \log^2 n )$ on the NNJAG model. No tight space lower bound was previously known even for the more restricted JAG model.

Computing Two-Dimensional Integer Hulls

Warwick Harvey

SIAM J. Comput. 28, pp. 2285-2299 (15 pages) | Cited 5 times

Online Publication Date: July 28, 2006

Full Text: | Download PDF

Show Abstract
An optimal algorithm is presented for computing the smallest set of linear inequalities that define the integer hull of a possibly unbounded two-dimensional convex polygon R. Input to the algorithm is a set of linear inequalities defining R, and the integer hull computed is the convex hull of the integer points of R. It is proven that the integer hull has at most O(n log Amax) inequalities, where n is the number of input inequalities and Amax is the magnitude of the largest input coefficient. It is shown that the algorithm presented has complexity O(n log Amax) and that this is optimal by proving that the integer hull may have $\Omega(n \log A_{max})$ inequalities in the worst case.
Close

close